-- Logs begin at Wed 2022-08-24 10:25:02 UTC, end at Wed 2022-08-24 11:35:14 UTC. -- Aug 24 10:58:10.711079 dv-cinder-854272-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 10:58:10.720233 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:58:10 2022] *** Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: nodename: dv-cinder-854272-2-iscsi Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: machine: x86_64 Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: clock source: unix Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: pcre jit disabled Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: detected number of CPU cores: 4 Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: current working directory: / Aug 24 10:58:10.722212 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:58:10.722843 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: your processes number limit is 47680 Aug 24 10:58:10.722843 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: your memory page size is 4096 bytes Aug 24 10:58:10.722843 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: detected max file descriptor number: 2048 Aug 24 10:58:10.722843 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: lock engine: pthread robust mutexes Aug 24 10:58:10.722843 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: thunder lock: enabled Aug 24 10:58:10.722843 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 10:58:10.722843 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:58:10.760798 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: Python main interpreter initialized at 0x5577e0f909c0 Aug 24 10:58:10.760798 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: python threads support enabled Aug 24 10:58:10.760798 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: your server socket listen backlog is limited to 100 connections Aug 24 10:58:10.760798 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:58:10.761158 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:58:10.761158 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: *** Operational MODE: preforking *** Aug 24 10:58:10.761459 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:58:10.761459 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: spawned uWSGI master process (pid: 105752) Aug 24 10:58:10.761659 dv-cinder-854272-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 10:58:10.762683 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: spawned uWSGI worker 1 (pid: 105753, cores: 1) Aug 24 10:58:10.762683 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: spawned uWSGI worker 2 (pid: 105754, cores: 1) Aug 24 10:58:10.762683 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:58:11.421449 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:58:11.436497 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:58:12.504775 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:58:12.504775 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: from cryptography.utils import int_from_bytes Aug 24 10:58:12.505399 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:58:12.505399 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: from cryptography.utils import int_from_bytes Aug 24 10:58:12.518037 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:58:12.518037 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: from cryptography.utils import int_from_bytes Aug 24 10:58:12.518506 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:58:12.518506 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: from cryptography.utils import int_from_bytes Aug 24 10:58:14.959326 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:58:14.959981 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:58:14.960083 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:58:14.960446 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:58:14.960668 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:58:14.961071 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.961392 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.961703 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.962017 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.962342 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.962646 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.962945 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.963286 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.963608 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.963868 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.964177 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.964495 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-2-iscsi {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.964815 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.965116 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.965418 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.965732 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.966030 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.966332 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.966731 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.967275 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.967720 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.968024 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.968396 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.968759 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.969053 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.969355 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.969669 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.969972 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.970293 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.970518 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:58:14.970969 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.971153 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:58:14.971256 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-2-iscsi {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.971349 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.971438 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:58:14.971599 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.971755 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:58:14.971940 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.972031 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:58:14.972305 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.972435 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.972613 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.972819 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.972913 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.973144 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.973233 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.973460 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.973556 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.973812 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.973907 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.974133 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.974217 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.974449 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.974533 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.974765 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.974858 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.975104 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.975193 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.975411 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.975513 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.975720 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.975813 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.976025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.976164 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-2-iscsi {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.976338 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.976494 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.976639 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.976800 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.976938 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.977109 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.977193 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.977472 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.977564 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.977791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.977969 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.978108 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.978193 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.978413 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.978497 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.978663 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.978910 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.979006 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.979252 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.979340 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.979569 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.979665 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.979874 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.979966 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.980184 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.980283 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.980486 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.980596 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.980794 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.980945 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.981100 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.981318 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.981406 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.981631 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.981768 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.981949 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.982034 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.982253 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.982346 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.982570 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.982653 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-2-iscsi {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.982885 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.982998 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.983212 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.983391 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.983528 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.983734 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.983966 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.984221 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.984306 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.984557 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.984677 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.984894 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.984991 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.985209 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.985294 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.985512 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.985653 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.985826 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.986016 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.986139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.986370 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.986455 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.986687 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.986771 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.987004 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.987121 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.987344 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.987427 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.987672 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.987757 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.987971 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.988065 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.988217 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.988355 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.988512 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.988667 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.988813 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.989031 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.989122 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.989393 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.989482 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.989652 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.989746 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.989956 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.990050 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.990280 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.990409 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.990568 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.990686 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.990874 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.990986 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.991269 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.991375 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.991519 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.991618 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.991833 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.991934 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.992143 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.992227 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.992444 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.992536 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.992742 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.992838 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.993041 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.993159 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.993353 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.993487 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.993666 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.993842 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.993967 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.994191 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.994278 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.994496 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.994581 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.994798 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.994895 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.995159 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.995256 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.995463 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.995548 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.995764 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.995891 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.996077 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.996177 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.996378 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.996541 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.996677 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.996988 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.997085 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.997269 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.997360 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.997577 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.997663 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.997888 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.997983 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.998184 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.998268 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.998486 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.998577 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.998796 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.998930 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.999115 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.999272 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.999436 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.999658 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:14.999857 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.000068 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.000295 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.000400 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.000606 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.000701 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.000913 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.001007 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.001210 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.001297 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.001506 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.001593 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.001802 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.001906 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.002115 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.002246 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.002428 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.002595 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.002729 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.002900 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.003029 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.003238 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.003345 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.003601 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.003688 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.003956 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.004042 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.004373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.004581 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.004667 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.004882 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.004967 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.005184 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.005269 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.005526 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.005614 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.005835 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.005923 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.006143 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.006243 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.006453 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.006538 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.006774 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.006869 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.007100 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.007210 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.007409 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.007520 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.007719 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.007853 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.008019 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.008205 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.008332 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.008565 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.008661 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.008869 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.008998 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.009216 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.009303 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.009520 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.009609 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.009823 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.009909 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.010130 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.010222 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.010430 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.010514 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.010753 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.010839 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.011086 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.011176 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.011424 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.011511 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.011764 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.011859 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.012073 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.012168 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.012396 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.012483 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.012712 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.012805 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.013020 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.013106 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.013329 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.013414 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.013636 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.013731 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.013952 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.014044 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.014281 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.014367 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.014590 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.014690 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.014903 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.014998 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.015338 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.015438 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.015658 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.015807 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.015965 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.016052 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.016272 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.016359 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.016578 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.016674 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.016910 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.016997 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.017221 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.017307 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.017532 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.017627 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.017842 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.017936 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:58:15.018155 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.018241 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.018470 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.018594 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.018776 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.019001 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.019171 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.019345 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.019456 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.019674 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.019772 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.019971 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.020057 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.020274 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.020370 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.020583 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.020708 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.020906 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.021051 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.021237 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.021428 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.021526 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.021801 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.021896 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.022140 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.022235 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.022443 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.022535 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.022749 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.022835 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.023075 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.023178 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.023454 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.023539 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.023759 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.023857 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.024067 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.024204 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.024372 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.024580 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.024689 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.024943 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.025038 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.025281 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.025365 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.025601 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.025687 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.025902 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.026021 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.026203 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.026392 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.026512 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.026791 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.026887 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.027149 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.027238 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.027459 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.027557 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.027768 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.027951 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.028118 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.028330 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.028423 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.028672 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.028765 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.029042 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.029136 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.029364 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.029538 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.029670 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.029795 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.029995 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.030094 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.030319 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.030454 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.030678 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.031034 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.031211 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.031337 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.031421 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.031716 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.031822 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.032018 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.032168 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.032354 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.032511 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.032653 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.032865 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.033011 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.033205 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.033343 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.033505 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.033633 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.033807 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.033965 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.034100 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.034308 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.034440 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.034688 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.034828 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.035009 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.035130 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.035345 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.035442 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.035647 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.035762 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.036002 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.036125 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.036306 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.036468 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.036657 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.036832 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.036993 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.037169 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.037309 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.037524 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.037614 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.037898 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.037985 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.038221 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.038313 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.038529 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.038615 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.038838 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.038931 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.039175 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.039338 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.039485 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.039694 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.039790 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.040053 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.040148 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.040401 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.040486 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.040711 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.040812 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.041037 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.041170 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.041350 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.041437 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.041671 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.041788 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.041972 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.042141 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.042284 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.042456 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.042625 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.042835 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.042953 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.043248 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.043338 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.043598 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.043698 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.043911 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.043997 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.044222 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.044308 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.044528 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.044623 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.044833 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.044993 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.045139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.045370 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.045465 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.045714 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.045803 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.046038 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.046122 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.046527 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.046629 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.046953 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.047086 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.047228 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.047316 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.047563 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.048002 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.048221 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.048336 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.048524 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.048692 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.048837 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.049068 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.049177 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.049438 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.049524 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.049809 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.049907 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.050120 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.050222 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.050449 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.050538 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.050757 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.050861 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.051089 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.051217 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.051400 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.051538 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.051700 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.051901 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.052003 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.052268 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.052364 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.052589 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.052680 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.052898 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.053017 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.053205 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.053300 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.053505 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.053630 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.053819 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.053952 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.054128 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.054289 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.054426 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.054652 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.054746 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.054981 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.055084 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.055358 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.055481 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.055669 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.055852 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.055985 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.056256 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.056351 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.056592 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.056692 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.056893 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.057000 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.057209 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.057340 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.057519 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.057707 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.057811 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.058079 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.058199 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.058390 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.058483 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.058731 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.058848 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.059035 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.059190 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.059355 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.059584 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.059661 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.059862 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.059957 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.060225 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.060339 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.060553 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.060646 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.060862 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.060974 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.061176 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.061272 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.061488 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.061613 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.061798 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.062041 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.062143 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.062373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.062465 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.062728 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.062852 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.063032 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.063158 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.063359 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.063532 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.063675 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.063880 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.063969 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.064255 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.064366 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.064567 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.064659 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.064868 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.064967 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.065170 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.065291 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.065491 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.065650 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.066032 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.066139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.066367 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.066462 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.066684 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.066798 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.066997 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.067101 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.067339 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.067448 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.067755 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.067843 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.068088 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.068188 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.068409 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.068518 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.068746 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.068886 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.069055 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.069170 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.069358 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.069485 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.069656 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.069847 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.069957 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.070231 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.070332 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.070557 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.070658 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.070859 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.070949 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.071178 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.071307 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.071493 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.071629 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.071796 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.071992 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.072091 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.072359 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.072472 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.072673 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.072792 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.072981 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.073101 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.073277 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.073416 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.073582 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.073805 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.073921 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.074169 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.074275 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.074479 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.074574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.074784 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.074933 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.075108 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.075258 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.075408 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.075578 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.075756 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.075952 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.076049 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.076312 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.076418 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.076651 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.076736 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.077025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.077145 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.077331 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.077417 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.077695 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.077823 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.078021 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.078160 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.078323 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.078512 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.078613 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.078868 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.078966 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.079226 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.079333 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.079532 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.079624 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.079831 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.079965 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.080136 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.080323 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.080426 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.080651 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.080737 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.081021 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.081143 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.081319 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.081430 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.081620 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.081721 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.081915 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.082083 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.082227 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.082460 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.082563 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.082797 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.082936 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.083127 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.083221 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.083439 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.083535 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.083817 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.083910 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.084118 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.084229 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.084423 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.084541 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.084720 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.084900 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.085048 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.085265 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.085367 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.085600 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.085717 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.085896 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.085982 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.086203 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.086296 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.086508 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.086645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.086811 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.087009 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.087147 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.087392 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.087565 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.087733 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.087843 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.088034 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.088126 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.088338 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.088459 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.088638 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.088741 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.088937 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.089243 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.089334 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.089559 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.089732 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.089871 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.090076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.090165 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.090445 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.090543 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.090752 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.090837 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.091211 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.091313 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.091543 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.091636 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.091835 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.091929 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.092132 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.092292 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.092430 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.092645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.092748 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.093011 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.093119 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.093349 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.093435 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.093673 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.093816 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.093973 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.094108 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.094270 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.094466 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.094561 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.094821 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.094908 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.095196 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.095295 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.095492 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.095592 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.095850 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.095936 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.096153 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.096255 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.096466 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.096554 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.096781 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.096903 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.097088 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.097246 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.097394 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.097606 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.097701 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.097943 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.098028 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.098286 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.098383 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.098593 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.098687 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.098903 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.098998 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.099227 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.099392 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.099525 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.099740 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.099833 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.100093 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.100188 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.100424 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.100510 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.100740 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.100826 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.101061 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.101177 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.101376 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.101555 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.101672 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.101954 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.102049 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.102313 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.102409 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.102617 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.102703 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.102918 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.103004 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.103258 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.103353 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.103561 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.103700 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.103864 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.104003 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.104169 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.104370 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.104482 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.104702 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.104923 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.105057 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.105465 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.105562 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.105810 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.106068 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.106177 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.106556 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.106657 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.106915 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.107276 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.107367 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.107582 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.107680 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.107949 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.108053 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.108268 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.108354 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.108583 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.108680 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.108940 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.109095 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.109256 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.109375 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.109572 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.109729 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.110032 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.110123 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.110400 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.110487 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.110713 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.110808 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.111025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.111133 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.111364 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.111451 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.111675 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.111764 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.111987 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.112122 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.112299 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.112460 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.112609 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.112814 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.113170 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.113383 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.113530 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.113891 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.113989 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.114246 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.114520 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.114608 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.114954 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.115155 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.115323 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.115675 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.115807 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.116042 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.116208 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.116406 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.116525 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.116785 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.116881 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.117115 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.117215 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.117448 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.117549 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.117755 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.117850 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.118080 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.118187 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.118385 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.118500 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.118711 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.118825 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.119156 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.119280 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.119468 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.119556 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.119772 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.119897 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.120187 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.120299 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.120492 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.120597 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.120804 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.120897 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.121126 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.121240 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.121449 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.121540 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.121768 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.121868 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.122074 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.122222 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.122385 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.122599 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.122686 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.122963 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.123074 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.123335 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.123421 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.123644 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.123730 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.123957 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.124099 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.124259 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.124525 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.124729 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.124891 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.125201 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.125297 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.125522 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.125621 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.125843 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.125929 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.126260 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.126348 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.126586 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.126672 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.126897 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.126984 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.127246 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.127352 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.127577 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.127686 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.127880 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.128080 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.128179 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.128403 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.128490 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.128764 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.128849 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.129066 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.129161 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.129388 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.129474 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.129687 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.129843 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.129994 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.130197 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.130284 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.130579 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.130690 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.130885 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.130978 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.131214 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.131314 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.131536 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.131623 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.131837 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.131958 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.132158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.132321 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.132469 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.132691 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.132786 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.133033 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.133121 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.133381 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.133500 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.133702 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.133799 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.134010 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.134096 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.134310 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.134426 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.134611 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.134715 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.134910 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.135072 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.135280 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.135462 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.135571 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.135805 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.136043 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.136182 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.136381 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.136503 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.136710 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.136872 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.137020 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.137212 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.137353 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.137548 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.137676 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.137992 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.138084 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.138306 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.138394 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.138626 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.138746 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.138927 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.139103 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.139253 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.139467 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.139553 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.139839 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.139935 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.140230 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.140326 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.140668 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.140764 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.140925 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.141014 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.141228 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.141414 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.141531 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.141781 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.141881 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.142116 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.142213 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.142420 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.142513 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.142739 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.142826 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.143079 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.143216 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.143363 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.143496 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.143813 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.143911 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.144125 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.144222 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.144470 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.144557 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.144771 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.144866 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.145098 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.145187 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.145406 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.145493 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.145728 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.145829 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.146047 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.146245 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.146413 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.146611 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.146714 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.146963 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.147145 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.147448 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.147610 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.147818 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.147998 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.148159 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.148479 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.148613 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.148788 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.148876 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.149107 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.149203 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.149423 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.149511 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.149739 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.149877 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.150249 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.150347 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.150590 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.150676 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.150904 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.150998 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.151242 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.151333 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.151554 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.151693 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.151865 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.152055 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.152176 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.152410 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.152586 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.152785 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.152974 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.153146 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.153371 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.153501 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.153797 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.153940 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.154121 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.154314 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.154446 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.154652 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.154771 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.155025 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.155134 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.155433 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.155521 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.155808 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.155905 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.156121 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.156227 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.156429 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.156525 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.156785 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.156879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.157099 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.157195 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.157406 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.157494 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.157777 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.157909 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.158175 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.158289 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.158537 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.158676 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.158875 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.159031 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.159255 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.159356 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.159611 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.159698 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.159953 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.160039 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.160264 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.160401 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.160574 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.160743 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.160888 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.161044 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.161203 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.161396 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.161525 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.161776 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.161862 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.162148 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.162245 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.162461 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.162547 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.162773 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.162876 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.163111 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.163216 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.163584 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.163670 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.163920 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.164005 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.164254 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.164342 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.164553 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.164646 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.164888 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.164972 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.165213 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.165300 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.165537 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.165681 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.165864 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.166066 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.166176 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.166412 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.166546 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.166744 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.166830 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.167067 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.167170 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.167380 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.167530 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.167709 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.167914 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.168084 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.168302 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.168391 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.168681 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.168773 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.169022 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.169115 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.169410 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.169551 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.169779 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.169898 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.170153 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.170253 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.170520 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.170614 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.170845 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.170933 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.171172 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.171355 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.171560 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.171646 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.171914 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.172002 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.172220 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.172380 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.172523 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.173130 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.173231 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.173480 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.173574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.173781 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.173879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.174085 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.174175 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.174393 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.174497 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.174700 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.174901 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.174988 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.175299 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.175391 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.175616 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.175707 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.175941 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.176068 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.176243 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.176466 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.176563 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.176839 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.176925 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.177147 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.177240 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.177455 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.177580 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.177757 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.177960 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.178048 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.178341 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.178447 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.178648 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.178735 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.178951 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.179141 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.179277 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.179512 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.179599 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.179869 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.179957 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.180166 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.180310 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.180482 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.180611 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.180777 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.181106 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.181212 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.181406 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.181507 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.181764 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.181850 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.182079 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.182164 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.182403 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.182490 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.182694 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.182778 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.183001 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.183113 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.183335 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.183437 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.183640 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.183734 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.183946 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.184054 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.184250 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.184493 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.184630 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.184825 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.184934 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.185146 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.185236 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.185474 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.185560 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.185804 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.185943 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.186116 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.186301 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.186425 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.186676 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.186764 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.187131 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.187251 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.187557 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.187646 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.187872 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.187988 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.188179 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.188270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.188488 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.188576 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.188798 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.188953 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.189109 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.189323 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.189410 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.189689 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.189785 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.190005 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.190091 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.190308 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.190402 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.190616 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.190764 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.190927 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.191148 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.191295 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.191530 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.191661 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.191849 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.191981 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.192194 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.192325 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.192509 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.192652 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.192824 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.193028 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.193161 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.193410 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.193555 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.193710 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.193847 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.194017 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.194153 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.194321 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.194457 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.194625 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.194937 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.195101 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.195293 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.195427 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.195606 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.195755 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.195908 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.196044 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.196324 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.196415 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.196635 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.196780 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.196951 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.197108 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.197269 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.197467 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.197576 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.197774 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.197894 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.198125 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.198225 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.198494 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.198590 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.198809 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.198895 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.199138 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.199279 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.199468 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.199664 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.199802 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.200032 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.200127 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.200366 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.200453 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.200721 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.200808 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.201026 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.201114 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.201327 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.201633 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.201719 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.201948 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.202079 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.202253 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.202427 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.202573 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.202784 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.202872 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.203186 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.203275 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.203485 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.203585 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.203783 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.203909 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.204081 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.204266 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.204378 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.204636 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.204731 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.204961 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.205046 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.205260 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.205360 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.205554 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.205719 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.205849 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.206087 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.206182 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.206420 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.206508 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.206720 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.206851 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.207016 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.207159 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.207329 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.207505 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.207618 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.207848 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.207935 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.208200 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.208358 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.208524 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.208658 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.208853 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.208996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.209167 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.209300 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.209536 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.209677 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.209818 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.209950 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.210093 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.210307 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.210439 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.210677 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.210809 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.210998 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.211192 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.211326 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.211457 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.211626 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.211763 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.211956 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.212099 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.212264 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.212407 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.212570 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.212783 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.212924 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.213169 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.213308 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.213473 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.213564 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.213777 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.213917 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.214098 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.214230 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.214422 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.214567 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.214723 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.214923 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.215072 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.215341 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.215474 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.215672 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.215801 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.215981 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.216117 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.216288 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.216423 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.216614 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.216758 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.216924 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.217115 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.217213 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.217481 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.217579 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.217801 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.217889 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.218106 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.218534 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.218676 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.218838 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.218941 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.219296 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.219418 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.219618 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.219741 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.219930 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.220119 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.220255 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.220495 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.220588 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.220873 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.220996 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.221197 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.221281 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.221524 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.221642 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.221868 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.221988 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.222178 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.222320 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.222521 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.222709 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.222846 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.223103 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.223200 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.223484 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.223578 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.223785 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.223954 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.224041 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:58:15.224214 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.224596 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.224964 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.225326 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.225701 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.226067 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.226442 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.226816 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.227232 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.227659 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.228015 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.228378 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.228757 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.229131 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.229474 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.229838 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.230215 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.230539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.230903 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.231306 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.231691 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.232071 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.232559 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.232932 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.233315 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.233723 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.234156 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.234546 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.234927 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.235357 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.235758 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.236127 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.236525 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.236917 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.237319 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.237740 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.238110 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.238481 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.238851 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.239242 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.239630 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.240015 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.240387 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.240756 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.241137 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.241495 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.241871 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.242242 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.242601 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.242986 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.243420 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.243787 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.244152 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.244518 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.244885 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.245256 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.245643 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.245958 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.246263 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.246565 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.246867 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.247191 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.247522 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.247922 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.248306 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.248697 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.249073 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.249500 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.250025 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.250388 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.250748 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.251152 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.251530 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.251928 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.252299 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.252688 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.253078 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.253458 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.253833 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.254211 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.254598 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.255004 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.255431 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.255821 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.256205 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.256597 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.256976 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.257375 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.257781 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.258160 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.258536 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.258917 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.259332 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.259718 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.260103 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.260483 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.260856 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.261243 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.261627 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.262055 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.262485 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.262875 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.263330 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.263739 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.264157 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.264535 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.264969 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.265416 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.265801 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.266183 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.266564 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:58:15.266874 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:58:15.384854 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO dbcounter [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Registered counter for database nova_api Aug 24 10:58:15.408851 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_db.sqlalchemy.engines [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.416583 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writer thread running {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:15.447868 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO dbcounter [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Registered counter for database nova_api Aug 24 10:58:15.472640 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_db.sqlalchemy.engines [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.478583 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.context [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f543127f-8947-4c5e-9781-e6e09b81ac8e(cell1) {{(pid=105753) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:58:15.480710 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writer thread running {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:15.482755 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:15.483256 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:15.485461 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:15.486214 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:15.486658 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:15.488712 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:15.490781 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO dbcounter [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Registered counter for database nova_cell0 Aug 24 10:58:15.496540 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO dbcounter [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Registered counter for database nova_cell1 Aug 24 10:58:15.504337 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_db.sqlalchemy.engines [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.505666 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_db.sqlalchemy.engines [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.512381 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writer thread running {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:15.514196 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writer thread running {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:15.550180 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.context [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f543127f-8947-4c5e-9781-e6e09b81ac8e(cell1) {{(pid=105754) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:58:15.554865 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_concurrency.lockutils [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:15.555434 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_concurrency.lockutils [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:15.557400 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_concurrency.lockutils [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:15.558221 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_concurrency.lockutils [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:58:15.558771 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_concurrency.lockutils [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:58:15.561101 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_concurrency.lockutils [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:58:15.563597 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO dbcounter [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Registered counter for database nova_cell0 Aug 24 10:58:15.569814 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO dbcounter [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Registered counter for database nova_cell1 Aug 24 10:58:15.578054 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_db.sqlalchemy.engines [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.580071 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_db.sqlalchemy.engines [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.586648 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writer thread running {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:15.592701 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writer thread running {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:15.658364 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO dbcounter [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Registered counter for database nova_cell0 Aug 24 10:58:15.673862 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_db.sqlalchemy.engines [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.678865 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writer thread running {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:15.735683 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO dbcounter [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Registered counter for database nova_cell0 Aug 24 10:58:15.744723 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG oslo_db.sqlalchemy.engines [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:58:15.749689 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writer thread running {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:58:16.014240 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: WARNING keystonemiddleware.auth_token [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:58:16.021451 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: WARNING keystonemiddleware.auth_token [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:58:16.063156 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: WARNING keystonemiddleware.auth_token [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:58:16.070392 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: WARNING keystonemiddleware.auth_token [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:58:16.362708 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: WARNING keystonemiddleware.auth_token [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:58:16.368812 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: WARNING keystonemiddleware.auth_token [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:58:16.374109 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577e0f909c0 pid: 105753 (default app) Aug 24 10:58:16.376325 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:58:16.377520 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001809 Aug 24 10:58:16.377935 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Wed Aug 24 10:58:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:58:16.407936 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: WARNING keystonemiddleware.auth_token [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:58:16.413895 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: WARNING keystonemiddleware.auth_token [None req-26932bf8-5eca-40bf-8939-3056043f9d0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:58:16.419192 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577e0f909c0 pid: 105754 (default app) Aug 24 10:59:35.572836 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:35.573696 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 10:59:35.574307 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:35.586970 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writing DB stats nova_api:SELECT=3 {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:35.588113 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writing DB stats nova_cell0:SELECT=3 {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:35.588793 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writing DB stats nova_cell1:SELECT=3 {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:35.590126 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writing DB stats nova_cell0:SELECT=3 {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:36.451354 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-c5a9b157-ed25-4e16-99d9-efe9373998d3 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:36.484194 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-c5a9b157-ed25-4e16-99d9-efe9373998d3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902308 Aug 24 10:59:36.487094 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 24 10:59:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:59:38.832987 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:38.834057 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-48e4d649-4dd5-4cb5-8cfb-bf77dacb4405 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 10:59:38.834559 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:39.298857 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-bf696ea1-e428-437b-a5c8-af4f0510f367 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:39.320164 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:59:39.320164 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: warnings.warn(msg) Aug 24 10:59:39.352089 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-bf696ea1-e428-437b-a5c8-af4f0510f367 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511092 Aug 24 10:59:39.352674 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 10:59:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:59:39.366788 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_api:SELECT=3 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:39.367689 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_cell0:SELECT=3 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:39.368622 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_cell1:SELECT=3 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:39.369673 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:39.576921 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-63df45d2-6eaa-4464-8eb4-8018c425482b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:39.581718 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:59:39.581718 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: warnings.warn(msg) Aug 24 10:59:39.655274 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-63df45d2-6eaa-4464-8eb4-8018c425482b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293863 Aug 24 10:59:39.665353 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 24 10:59:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:42.197822 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-bf696ea1-e428-437b-a5c8-af4f0510f367 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:42.199077 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-bf696ea1-e428-437b-a5c8-af4f0510f367 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Aug 24 10:59:42.199758 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:42.864215 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-41907620-f7bd-44a0-a2e9-413153607a7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "swap": 0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:42.883735 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:59:42.883735 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: warnings.warn(msg) Aug 24 10:59:42.912882 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-41907620-f7bd-44a0-a2e9-413153607a7f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706532 Aug 24 10:59:42.914148 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 10:59:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:59:42.930893 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-43ac3fa6-9aee-4269-936b-9710ad1f7e41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:42.933841 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:59:42.933841 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: warnings.warn(msg) Aug 24 10:59:42.967131 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-43ac3fa6-9aee-4269-936b-9710ad1f7e41 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043958 Aug 24 10:59:42.967942 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 24 10:59:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:59:45.400352 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-41907620-f7bd-44a0-a2e9-413153607a7f admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:45.401365 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-41907620-f7bd-44a0-a2e9-413153607a7f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 24 10:59:45.401744 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:45.825008 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-d6c670f5-0266-4c70-94e0-9d853bc8df5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:45.845123 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-d6c670f5-0266-4c70-94e0-9d853bc8df5e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436923 Aug 24 10:59:45.845689 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 10:59:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:59:45.857907 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-2148ec5e-7d9c-41e1-ae1b-32f18060c34c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:45.885159 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-2148ec5e-7d9c-41e1-ae1b-32f18060c34c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031006 Aug 24 10:59:45.885732 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 24 10:59:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:48.273840 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-d6c670f5-0266-4c70-94e0-9d853bc8df5e admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:48.275538 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-d6c670f5-0266-4c70-94e0-9d853bc8df5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Aug 24 10:59:48.276224 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:48.774072 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-e025fc48-395b-4e9a-a80d-bff0a2b84f1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "ram": 2048, "disk": 10, "vcpus": 2}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:48.796924 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-e025fc48-395b-4e9a-a80d-bff0a2b84f1d admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512992 Aug 24 10:59:48.797639 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 10:59:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:59:48.809963 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-537b0c26-4b14-4a67-a0c4-1bcaca227d0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:48.834285 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-537b0c26-4b14-4a67-a0c4-1bcaca227d0c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028054 Aug 24 10:59:48.835074 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 24 10:59:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:59:51.238763 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-e025fc48-395b-4e9a-a80d-bff0a2b84f1d admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:51.240584 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-e025fc48-395b-4e9a-a80d-bff0a2b84f1d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002353 Aug 24 10:59:51.246740 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:51.677823 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-6e28f6a9-b82b-4f34-889e-e72f31591067 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:51.697555 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-6e28f6a9-b82b-4f34-889e-e72f31591067 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449198 Aug 24 10:59:51.699079 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 10:59:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:59:51.710876 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-03bb82aa-3611-4d98-b651-67d89c50fbc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:51.738360 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-03bb82aa-3611-4d98-b651-67d89c50fbc2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031436 Aug 24 10:59:51.743429 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1336 bytes} [Wed Aug 24 10:59:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:59:54.122769 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-6e28f6a9-b82b-4f34-889e-e72f31591067 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:54.124496 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-6e28f6a9-b82b-4f34-889e-e72f31591067 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002454 Aug 24 10:59:54.125223 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:54.561636 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-fe485639-dc32-4d36-bbc3-0ea759c4dd52 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:54.593350 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-fe485639-dc32-4d36-bbc3-0ea759c4dd52 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460614 Aug 24 10:59:54.594066 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 24 10:59:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:59:57.090230 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-6e28f6a9-b82b-4f34-889e-e72f31591067 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:57.091292 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-6e28f6a9-b82b-4f34-889e-e72f31591067 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 10:59:57.091695 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:59:57.565423 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-a89b354b-463a-498a-b18e-013022120038 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:57.586821 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-a89b354b-463a-498a-b18e-013022120038 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.488683 Aug 24 10:59:57.587726 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 10:59:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:59:57.600445 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-120027c9-5604-404a-ba1a-520bee30349c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:59:57.627439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-120027c9-5604-404a-ba1a-520bee30349c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031124 Aug 24 10:59:57.628060 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 24 10:59:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:59:59.979639 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-a89b354b-463a-498a-b18e-013022120038 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:59:59.980549 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-a89b354b-463a-498a-b18e-013022120038 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 24 10:59:59.980952 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 10:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:00.391966 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-35a53d89-98ac-4b5a-976c-254c6ecff1a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:00.412561 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-35a53d89-98ac-4b5a-976c-254c6ecff1a6 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425082 Aug 24 11:00:00.413558 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 10:59:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:00:00.426789 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-0bfa0cb0-a04c-4109-867a-2570fc19c16c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:00.453472 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-0bfa0cb0-a04c-4109-867a-2570fc19c16c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030306 Aug 24 11:00:00.454436 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 24 11:00:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:02.873295 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-35a53d89-98ac-4b5a-976c-254c6ecff1a6 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:02.874323 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-35a53d89-98ac-4b5a-976c-254c6ecff1a6 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 24 11:00:02.874725 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 11:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:03.326361 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-b6187e4b-ba58-45e6-b06a-cf0bec7283ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:03.347957 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-b6187e4b-ba58-45e6-b06a-cf0bec7283ad admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.465811 Aug 24 11:00:03.348762 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 11:00:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:00:03.362179 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-5e39623a-eca2-4a13-91e2-723761d12207 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:03.392014 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-5e39623a-eca2-4a13-91e2-723761d12207 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034732 Aug 24 11:00:03.393250 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 24 11:00:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:05.854224 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-b6187e4b-ba58-45e6-b06a-cf0bec7283ad admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:05.855910 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-b6187e4b-ba58-45e6-b06a-cf0bec7283ad admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Aug 24 11:00:05.856470 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 11:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:06.321577 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-7cd0dba5-f18a-4175-ad30-3f338770cdd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:06.331535 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:06.349114 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-7cd0dba5-f18a-4175-ad30-3f338770cdd0 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485691 Aug 24 11:00:06.349787 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 11:00:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:00:06.362025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-e69ee6c2-05f0-4bfb-b998-1a4fd95b3e7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:06.387487 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-e69ee6c2-05f0-4bfb-b998-1a4fd95b3e7b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029305 Aug 24 11:00:06.388049 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 24 11:00:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:08.780265 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-7cd0dba5-f18a-4175-ad30-3f338770cdd0 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:08.781281 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-7cd0dba5-f18a-4175-ad30-3f338770cdd0 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 24 11:00:08.781702 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 11:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:09.228398 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-9a6b3885-be49-4262-9e1e-135873d59ae1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge"}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:09.252024 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-9a6b3885-be49-4262-9e1e-135873d59ae1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463990 Aug 24 11:00:09.252584 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1283 bytes} [Wed Aug 24 11:00:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:00:09.265091 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-a687ce2d-490e-4f77-8679-3dc0631aaf06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:09.292087 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-a687ce2d-490e-4f77-8679-3dc0631aaf06 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031092 Aug 24 11:00:09.303072 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1333 bytes} [Wed Aug 24 11:00:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:00:28.364716 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-9a6b3885-be49-4262-9e1e-135873d59ae1 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:28.365733 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-9a6b3885-be49-4262-9e1e-135873d59ae1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 11:00:28.366106 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 11:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:00:28.380402 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:28.819466 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-3d213d28-e1ea-4b51-9d01-86e0c912f610 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:28.842260 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-3d213d28-e1ea-4b51-9d01-86e0c912f610 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.469160 Aug 24 11:00:28.842802 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 24 11:00:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:00:29.943568 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-9a6b3885-be49-4262-9e1e-135873d59ae1 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:29.944580 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-9a6b3885-be49-4262-9e1e-135873d59ae1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 24 11:00:29.944975 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:30.542935 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-5a825236-0044-426d-b0c6-e11e6fc043a1 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:30.549111 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.wsgi [None req-5a825236-0044-426d-b0c6-e11e6fc043a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-5a825236-0044-426d-b0c6-e11e6fc043a1 admin admin] Request method failure captured: Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Accept: application/json Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Accept-Encoding: gzip, deflate Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Connection: keep-alive Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Content-Length: 0 Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Host: 10.222.0.79 Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Openstack-Api-Version: compute 2.90 Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Openstack-System-Scope: None Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: User-Agent: python-novaclient Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Auth-Token: gAAAAABjBgTNOtwXDQpAN-PDZGu75hO_9QTMtQPDHPFuOhzpbiFUNRu5sZPXZkyFvPVG8DtA4Q2uy9n8n6ZI4A2c7lr0v2R8nnpbt6xcBPiBQV7bHpaX5b9HYfCFtykRAWItXjbjjr9TPT9W3shf5X7M4H7tlfjIJIwBMlxVnIPfG2YDDid6FKs Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Domain-Id: None Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Domain-Name: None Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Identity-Status: Confirmed Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Is-Admin-Project: True Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Domain-Id: default Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Domain-Name: Default Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Name: admin Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Role: admin,reader,member Aug 24 11:00:30.552645 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Roles: admin,reader,member Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_500fe03a305a47bfb676009321d5e688", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/500fe03a305a47bfb676009321d5e688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant: admin Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant-Name: admin Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User: admin Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Domain-Id: default Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Domain-Name: Default Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Id: 753b90ffd269458d8ab6c1a358e270e4 Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Name: admin Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: method: > Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: exception: Flavor 42 could not be found. Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: action_args: {'id': '42'} Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:00:30.554270 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:30.555173 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.556439 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-5a825236-0044-426d-b0c6-e11e6fc043a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:00:30.557494 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-5a825236-0044-426d-b0c6-e11e6fc043a1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.473087 Aug 24 11:00:30.557494 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 24 11:00:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:30.563975 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-6b4205d7-9437-4b9f-b67f-16070ee26df1 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:30.568405 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:30.588092 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-6b4205d7-9437-4b9f-b67f-16070ee26df1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027684 Aug 24 11:00:30.588645 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 24 11:00:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:00:30.598727 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-004088e2-9aed-4eac-99f0-5325db331283 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:30.623606 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-004088e2-9aed-4eac-99f0-5325db331283 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028504 Aug 24 11:00:30.624151 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 24 11:00:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:00:30.634053 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-5db9ed59-8ce3-4cc3-a8bf-b4f0eb1c101e admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:30.640352 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.wsgi [None req-5db9ed59-8ce3-4cc3-a8bf-b4f0eb1c101e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-5db9ed59-8ce3-4cc3-a8bf-b4f0eb1c101e admin admin] Request method failure captured: Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Accept: application/json Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Accept-Encoding: gzip, deflate Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Connection: keep-alive Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Content-Length: 0 Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Host: 10.222.0.79 Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Openstack-Api-Version: compute 2.90 Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Openstack-System-Scope: None Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: User-Agent: python-novaclient Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Auth-Token: gAAAAABjBgTNOtwXDQpAN-PDZGu75hO_9QTMtQPDHPFuOhzpbiFUNRu5sZPXZkyFvPVG8DtA4Q2uy9n8n6ZI4A2c7lr0v2R8nnpbt6xcBPiBQV7bHpaX5b9HYfCFtykRAWItXjbjjr9TPT9W3shf5X7M4H7tlfjIJIwBMlxVnIPfG2YDDid6FKs Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Domain-Id: None Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Domain-Name: None Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Identity-Status: Confirmed Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Is-Admin-Project: True Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Domain-Id: default Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Domain-Name: Default Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Name: admin Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Role: admin,reader,member Aug 24 11:00:30.643615 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Roles: admin,reader,member Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_500fe03a305a47bfb676009321d5e688", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/500fe03a305a47bfb676009321d5e688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant: admin Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant-Name: admin Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User: admin Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Domain-Id: default Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Domain-Name: Default Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Id: 753b90ffd269458d8ab6c1a358e270e4 Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Name: admin Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: method: > Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: exception: Flavor 42 could not be found. Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: action_args: {'id': '42'} Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:00:30.645158 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:30.645999 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:30.647025 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-5db9ed59-8ce3-4cc3-a8bf-b4f0eb1c101e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:00:30.648088 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-5db9ed59-8ce3-4cc3-a8bf-b4f0eb1c101e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014565 Aug 24 11:00:30.648088 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 24 11:00:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:31.665595 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-004088e2-9aed-4eac-99f0-5325db331283 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:31.667413 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-004088e2-9aed-4eac-99f0-5325db331283 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002314 Aug 24 11:00:31.668068 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:32.265310 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-ad807ee9-8ff7-4f60-a152-940221f6e0e1 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:32.271482 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.wsgi [None req-ad807ee9-8ff7-4f60-a152-940221f6e0e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-ad807ee9-8ff7-4f60-a152-940221f6e0e1 admin admin] Request method failure captured: Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Accept: application/json Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Accept-Encoding: gzip, deflate Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Connection: keep-alive Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Content-Length: 0 Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Host: 10.222.0.79 Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Openstack-Api-Version: compute 2.90 Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Openstack-System-Scope: None Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: User-Agent: python-novaclient Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Auth-Token: gAAAAABjBgTPLQBfnJBltT_22fcFLGZTUX-AUxhIUtHTn2vOs9moiFf_JEc2wKH11HOOQhfrk54Yw_jwTp1FHKijTgkBOgeOBVAat_2kREjG25xUTtI2t5Z9L-jvz_Wkz0FR7gpk5PxPaPMQVhPPKJwqO9qS3KnbXjdN-54wJzEJ9fMRME5wO4w Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Domain-Id: None Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Domain-Name: None Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Identity-Status: Confirmed Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Is-Admin-Project: True Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Domain-Id: default Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Domain-Name: Default Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Name: admin Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Role: admin,reader,member Aug 24 11:00:32.273008 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Roles: admin,reader,member Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_500fe03a305a47bfb676009321d5e688", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/500fe03a305a47bfb676009321d5e688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant: admin Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant-Name: admin Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User: admin Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Domain-Id: default Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Domain-Name: Default Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Id: 753b90ffd269458d8ab6c1a358e270e4 Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Name: admin Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: method: > Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: exception: Flavor 84 could not be found. Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: action_args: {'id': '84'} Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:00:32.274533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:32.275494 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.276791 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-ad807ee9-8ff7-4f60-a152-940221f6e0e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:00:32.278024 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-ad807ee9-8ff7-4f60-a152-940221f6e0e1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.469438 Aug 24 11:00:32.278024 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 24 11:00:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:32.285212 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-022a0fe1-ffbb-444c-8fcb-2ab967af777d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:32.301047 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-022a0fe1-ffbb-444c-8fcb-2ab967af777d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019450 Aug 24 11:00:32.301861 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 24 11:00:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:00:32.311533 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-56ea7091-f90e-40af-96b3-72b623da4e81 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:32.328245 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-56ea7091-f90e-40af-96b3-72b623da4e81 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020345 Aug 24 11:00:32.328777 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 24 11:00:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:00:32.338725 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-3eb0466e-d9d5-4b7f-9a68-55899a7daa09 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:32.344382 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.wsgi [None req-3eb0466e-d9d5-4b7f-9a68-55899a7daa09 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-3eb0466e-d9d5-4b7f-9a68-55899a7daa09 admin admin] Request method failure captured: Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Accept: application/json Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Accept-Encoding: gzip, deflate Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Connection: keep-alive Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Content-Length: 0 Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Host: 10.222.0.79 Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Openstack-Api-Version: compute 2.90 Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Openstack-System-Scope: None Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: User-Agent: python-novaclient Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Auth-Token: gAAAAABjBgTPLQBfnJBltT_22fcFLGZTUX-AUxhIUtHTn2vOs9moiFf_JEc2wKH11HOOQhfrk54Yw_jwTp1FHKijTgkBOgeOBVAat_2kREjG25xUTtI2t5Z9L-jvz_Wkz0FR7gpk5PxPaPMQVhPPKJwqO9qS3KnbXjdN-54wJzEJ9fMRME5wO4w Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Domain-Id: None Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Domain-Name: None Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Identity-Status: Confirmed Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Is-Admin-Project: True Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Domain-Id: default Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Domain-Name: Default Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Name: admin Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Role: admin,reader,member Aug 24 11:00:32.345879 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Roles: admin,reader,member Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_500fe03a305a47bfb676009321d5e688", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/500fe03a305a47bfb676009321d5e688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant: admin Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant-Name: admin Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User: admin Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Domain-Id: default Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Domain-Name: Default Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Id: 753b90ffd269458d8ab6c1a358e270e4 Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Name: admin Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: method: > Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: exception: Flavor 84 could not be found. Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: action_args: {'id': '84'} Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:00:32.347373 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:32.348247 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:32.349996 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-3eb0466e-d9d5-4b7f-9a68-55899a7daa09 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:00:32.351034 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-3eb0466e-d9d5-4b7f-9a68-55899a7daa09 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012053 Aug 24 11:00:32.351034 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Aug 24 11:00:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:33.368476 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-56ea7091-f90e-40af-96b3-72b623da4e81 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:33.369486 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-56ea7091-f90e-40af-96b3-72b623da4e81 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 24 11:00:33.369875 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:33.954435 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-16c404a0-c393-493f-a39c-b5531fc07ee7 admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:33.960568 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.wsgi [None req-16c404a0-c393-493f-a39c-b5531fc07ee7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-16c404a0-c393-493f-a39c-b5531fc07ee7 admin admin] Request method failure captured: Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Accept: application/json Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Accept-Encoding: gzip, deflate Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Connection: keep-alive Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Content-Length: 0 Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Host: 10.222.0.79 Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Openstack-Api-Version: compute 2.90 Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Openstack-System-Scope: None Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: User-Agent: python-novaclient Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Auth-Token: gAAAAABjBgTRJH7wFIVrEh3pW-b6EqnCkMiM5L5ppDRAXf-XbNrXZIHlA2bBWZtssmH55PKBNv8IlQFm2ECHdsnV5_n1Z5Gv3LOxpUcQsnZhMNtpy5Vwbr-XOy61_ZVYkjp4dVcpDTn89YqAEmTO2Sxjnw1INlDWKhWISycL4kDlVqoG0l2U5-0 Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Domain-Id: None Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Domain-Name: None Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Identity-Status: Confirmed Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Is-Admin-Project: True Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Domain-Id: default Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Domain-Name: Default Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Project-Name: admin Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Role: admin,reader,member Aug 24 11:00:33.962076 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Roles: admin,reader,member Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_500fe03a305a47bfb676009321d5e688", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/500fe03a305a47bfb676009321d5e688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant: admin Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-Tenant-Name: admin Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User: admin Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Domain-Id: default Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Domain-Name: Default Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Id: 753b90ffd269458d8ab6c1a358e270e4 Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: X-User-Name: admin Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: method: > Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: exception: Flavor 451 could not be found. Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: action_args: {'id': '451'} Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:00:33.963539 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:33.964517 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: ERROR nova.api.openstack.wsgi Aug 24 11:00:33.965574 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-16c404a0-c393-493f-a39c-b5531fc07ee7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:00:33.966872 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-16c404a0-c393-493f-a39c-b5531fc07ee7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.447520 Aug 24 11:00:33.966872 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 24 11:00:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:33.976430 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-4822f951-17b9-4239-b56f-3e22ecd9d3fc admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:33.996547 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-4822f951-17b9-4239-b56f-3e22ecd9d3fc admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026168 Aug 24 11:00:33.997039 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 24 11:00:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:00:34.007411 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:34.022602 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018674 Aug 24 11:00:34.023118 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Aug 24 11:00:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:00:34.035544 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-47693f2a-feea-425b-988b-f3f25f3496e5 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:34.044928 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.wsgi [None req-47693f2a-feea-425b-988b-f3f25f3496e5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-47693f2a-feea-425b-988b-f3f25f3496e5 admin admin] Request method failure captured: Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Accept: application/json Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Accept-Encoding: gzip, deflate Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Connection: keep-alive Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Content-Length: 0 Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Host: 10.222.0.79 Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Openstack-Api-Version: compute 2.90 Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Openstack-System-Scope: None Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: User-Agent: python-novaclient Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Auth-Token: gAAAAABjBgTRJH7wFIVrEh3pW-b6EqnCkMiM5L5ppDRAXf-XbNrXZIHlA2bBWZtssmH55PKBNv8IlQFm2ECHdsnV5_n1Z5Gv3LOxpUcQsnZhMNtpy5Vwbr-XOy61_ZVYkjp4dVcpDTn89YqAEmTO2Sxjnw1INlDWKhWISycL4kDlVqoG0l2U5-0 Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Domain-Id: None Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Domain-Name: None Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Identity-Status: Confirmed Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Is-Admin-Project: True Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Domain-Id: default Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Domain-Name: Default Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Project-Name: admin Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Role: admin,reader,member Aug 24 11:00:34.047745 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Roles: admin,reader,member Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_500fe03a305a47bfb676009321d5e688", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/500fe03a305a47bfb676009321d5e688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/500fe03a305a47bfb676009321d5e688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant: admin Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant-Id: 500fe03a305a47bfb676009321d5e688 Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-Tenant-Name: admin Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User: admin Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Domain-Id: default Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Domain-Name: Default Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Id: 753b90ffd269458d8ab6c1a358e270e4 Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: X-User-Name: admin Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: method: > Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: exception: Flavor 451 could not be found. Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: action_args: {'id': '451'} Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:00:34.049958 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:34.051139 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: ERROR nova.api.openstack.wsgi Aug 24 11:00:34.052891 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-47693f2a-feea-425b-988b-f3f25f3496e5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:00:34.054081 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-47693f2a-feea-425b-988b-f3f25f3496e5 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.020150 Aug 24 11:00:34.054081 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 24 11:00:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:35.079102 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:35.080105 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 24 11:00:35.080562 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:35.681425 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-cc72c022-5a79-47f6-8f8d-9f29a8be0225 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:35.706565 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-cc72c022-5a79-47f6-8f8d-9f29a8be0225 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.482837 Aug 24 11:00:35.707099 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 24 11:00:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:00:36.693307 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:36.694458 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Aug 24 11:00:36.694856 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:37.250246 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-ae3a0946-5731-4ab5-8316-0b2841269274 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:37.272917 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-ae3a0946-5731-4ab5-8316-0b2841269274 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.442320 Aug 24 11:00:37.273503 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 24 11:00:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:00:38.267198 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:38.268779 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002278 Aug 24 11:00:38.269397 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:38.872502 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-a0d34830-e7cc-43e6-a89c-60629a874ccd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:38.893874 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-a0d34830-e7cc-43e6-a89c-60629a874ccd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.486955 Aug 24 11:00:38.894602 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 24 11:00:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:00:39.908197 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:39.909524 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Aug 24 11:00:39.909994 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:40.520534 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-bbbee07c-1e03-489a-8be4-d483c2556451 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:00:40.542694 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-bbbee07c-1e03-489a-8be4-d483c2556451 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.488009 Aug 24 11:00:40.543282 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Aug 24 11:00:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:00:41.540465 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:41.541464 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 24 11:00:41.541838 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:00:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:00:42.139857 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-8703488f-c116-48ee-b5f5-f6a6afb87d1c admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:00:42.160642 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-8703488f-c116-48ee-b5f5-f6a6afb87d1c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.478078 Aug 24 11:00:42.161171 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Wed Aug 24 11:00:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:01:36.667650 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:36.668795 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-fda33407-2f1f-4829-9ac9-6f269e511b0d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002327 Aug 24 11:01:36.669314 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 931 bytes} [Wed Aug 24 11:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:01:36.680479 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:01:37.118699 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-40fa4a11-a977-468a-a2af-24c87a60f033 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:37.139320 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-40fa4a11-a977-468a-a2af-24c87a60f033 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.463300 Aug 24 11:01:37.139850 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1292 bytes} [Wed Aug 24 11:01:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:01:37.162162 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG dbcounter [-] [105754] Writing DB stats nova_api:SELECT=14 {{(pid=105754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:01:37.168143 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-04823d6e-ad04-4d65-a994-337d97e7d70c admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:37.176600 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-04823d6e-ad04-4d65-a994-337d97e7d70c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016694 Aug 24 11:01:37.177124 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1283 bytes} [Wed Aug 24 11:01:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:01:37.189682 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-b10ebcdb-fd0c-4ce5-af78-7cb86676497e admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:37.198039 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-b10ebcdb-fd0c-4ce5-af78-7cb86676497e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011998 Aug 24 11:01:37.198646 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1286 bytes} [Wed Aug 24 11:01:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:01:37.216163 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:37.227365 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016603 Aug 24 11:01:37.228006 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1286 bytes} [Wed Aug 24 11:01:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:01:37.243849 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-264e05b6-369e-49fe-a848-77d6df6bb455 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:01:37.252228 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-264e05b6-369e-49fe-a848-77d6df6bb455 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011859 Aug 24 11:01:37.252738 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1283 bytes} [Wed Aug 24 11:01:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:04:41.291430 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:41.292420 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 11:04:41.293007 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:04:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:41.433344 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_api:SELECT=6 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:41.612339 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:41.614698 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:04:41.614698 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: warnings.warn(msg) Aug 24 11:04:41.615836 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:41.616308 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:41.616732 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:41.617438 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:41.617889 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:41.618301 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:41.651321 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-3d662725-4df0-4cf0-afd5-e4b40100aadf admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.219339 Aug 24 11:04:41.651884 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 24 11:04:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:04:42.475550 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:42.476601 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 24 11:04:42.477007 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:04:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:42.693366 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:42.696446 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:04:42.696446 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: warnings.warn(msg) Aug 24 11:04:42.698135 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:42.698633 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:42.699228 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:42.700516 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:42.701067 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:42.701490 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:42.721416 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-ce10aedf-c31e-4b97-b641-63a7f5630776 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.103756 Aug 24 11:04:42.721972 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 24 11:04:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:04:53.953190 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:53.954365 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Aug 24 11:04:53.954755 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 36/73] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:54.098559 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_cell0:SELECT=4 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:54.099341 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_cell1:SELECT=4 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:54.099965 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG dbcounter [-] [105753] Writing DB stats nova_api:SELECT=8 {{(pid=105753) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:54.150752 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:54.153128 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:04:54.153128 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: warnings.warn(msg) Aug 24 11:04:54.154216 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:54.154693 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:54.155148 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:54.155913 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:54.156289 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:54.156706 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:54.182083 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-92c5d8fa-2fba-49bb-8933-ebbfe7d9ff57 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089023 Aug 24 11:04:54.182646 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 38/74] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 24 11:04:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:04:55.011394 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: DEBUG nova.api.openstack.wsgi [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] Calling method '>' {{(pid=105754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:55.012405 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: INFO nova.api.openstack.requestlog [None req-a22a7c98-f196-4ce6-8a8c-c456ae0e7d8f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 24 11:04:55.012797 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: [pid: 105754|app: 0|req: 37/75] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Aug 24 11:04:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:04:55.212548 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG nova.api.openstack.wsgi [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] Calling method '>' {{(pid=105753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:04:55.214872 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:04:55.214872 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: warnings.warn(msg) Aug 24 11:04:55.216051 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:55.216532 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:55.216961 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:55.217709 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:04:55.218152 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:04:55.218570 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: DEBUG oslo_concurrency.lockutils [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:04:55.241368 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: INFO nova.api.openstack.requestlog [None req-6ce3694a-ce17-484c-9007-e52fb78cf1e6 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088103 Aug 24 11:04:55.241910 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: [pid: 105753|app: 0|req: 39/76] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Aug 24 11:04:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:05:53.435308 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: Wed Aug 24 11:05:53 2022 - graceful shutdown triggered... Aug 24 11:05:53.435807 dv-cinder-854272-2-iscsi devstack@n-api.service[105754]: Gracefully killing worker 2 (pid: 105754)... Aug 24 11:05:53.435360 dv-cinder-854272-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 11:05:53.436602 dv-cinder-854272-2-iscsi devstack@n-api.service[105753]: Gracefully killing worker 1 (pid: 105753)... Aug 24 11:05:54.436510 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: worker 1 buried after 1 seconds Aug 24 11:05:54.436510 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: worker 2 buried after 1 seconds Aug 24 11:05:54.436510 dv-cinder-854272-2-iscsi devstack@n-api.service[105752]: goodbye to uWSGI. Aug 24 11:05:54.438174 dv-cinder-854272-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 11:05:54.438767 dv-cinder-854272-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 11:05:54.441963 dv-cinder-854272-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 11:05:54.453554 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:05:54 2022] *** Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: nodename: dv-cinder-854272-2-iscsi Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: machine: x86_64 Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: clock source: unix Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: pcre jit disabled Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: detected number of CPU cores: 4 Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: current working directory: / Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: your processes number limit is 47680 Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: your memory page size is 4096 bytes Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: detected max file descriptor number: 2048 Aug 24 11:05:54.455874 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: lock engine: pthread robust mutexes Aug 24 11:05:54.456908 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: thunder lock: enabled Aug 24 11:05:54.456908 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 11:05:54.456908 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:05:54.496808 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: Python main interpreter initialized at 0x55c2cbce99c0 Aug 24 11:05:54.496808 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: python threads support enabled Aug 24 11:05:54.496808 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: your server socket listen backlog is limited to 100 connections Aug 24 11:05:54.496808 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:05:54.497272 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:05:54.497272 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: *** Operational MODE: preforking *** Aug 24 11:05:54.497552 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:05:54.497552 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: spawned uWSGI master process (pid: 120774) Aug 24 11:05:54.497779 dv-cinder-854272-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 11:05:54.498388 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: spawned uWSGI worker 1 (pid: 120788, cores: 1) Aug 24 11:05:54.498652 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: spawned uWSGI worker 2 (pid: 120789, cores: 1) Aug 24 11:05:54.498811 dv-cinder-854272-2-iscsi devstack@n-api.service[120774]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:05:55.152324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:05:55.185789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:05:56.282752 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:05:56.282752 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: from cryptography.utils import int_from_bytes Aug 24 11:05:56.283470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:05:56.283470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: from cryptography.utils import int_from_bytes Aug 24 11:05:56.336379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:05:56.336379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: from cryptography.utils import int_from_bytes Aug 24 11:05:56.337039 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:05:56.337039 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: from cryptography.utils import int_from_bytes Aug 24 11:05:58.674592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:05:58.675334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:05:58.675436 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:05:58.675785 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:05:58.676026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:05:58.676409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.676729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.677038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.677324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.677812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.678353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.678676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.679028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.679349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.679604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.679918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.680235 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-2-iscsi {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.680655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.681000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.681324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.681646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.681948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.682268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.682567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.683134 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.684441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.684441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.684441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.684897 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.685096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.685393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.685723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.686011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.686333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.686635 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.687087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-2-iscsi {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.687388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.687700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.688006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.688425 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.688739 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.689042 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.689347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.689678 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.689980 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.690300 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.690619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.690933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.691283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.691578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.691879 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.692180 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.692512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.692790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.693085 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.693329 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.693628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.693943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.694262 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.694578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.694823 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.695083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.695405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.695718 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.696020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.696456 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.696787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.697088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.697392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.697690 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.697984 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.698282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.698612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.698907 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.699248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.699548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.699858 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.700257 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.700503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.700803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.701141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.701453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.701751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.702059 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.702372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.702671 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.702971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.703371 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.703685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.704016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.704314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.704559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.704855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.705155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.705669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.705975 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.706276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.706582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.706878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.707199 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.707504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.707804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.708106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.708408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.708697 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.709188 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.709490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.709786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.710315 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.710634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.710938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.711270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.711574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.712019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.712434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.712758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.713247 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.713566 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.713872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.714173 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.714489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.714789 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.715085 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.715421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.715714 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.716016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.716311 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.716608 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.716908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.717201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.717500 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.717797 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.718102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.718395 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.718690 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.719007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.719297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.719624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.719932 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.720254 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.720544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.720840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.721623 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.721623 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.721901 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.722109 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.722438 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.722757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.723090 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.723392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.723701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.724028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.724333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.724636 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.724947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.725258 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.725564 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.725889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.726197 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.726506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.726823 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.727151 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.727554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.728119 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.728444 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.728751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.729090 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.729434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.729740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.730058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.730399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.730691 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.730983 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.731449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.731627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.732616 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.732616 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.732616 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.732955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.733144 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.733449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.733753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.734057 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.734486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.734692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.735002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.735330 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.742664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.743605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.744649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.745083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.745483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.745576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.745812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.746145 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.746501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.746800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.747141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.747454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.747768 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.748066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.748366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.748635 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.748940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.749227 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.749532 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.749830 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.750156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.750422 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.750724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.751156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.751379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.751689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.751940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.752268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.752530 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.752868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.753215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.753588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.753810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.755082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.755082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.755082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.755082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.755711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.755711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.755986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.756208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.756525 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.756833 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.757149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.757456 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.757562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:05:58.757983 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.758080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:05:58.758154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.758335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:05:58.758429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.758689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.758817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:05:58.759125 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.759491 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.759793 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.760105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.760283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:05:58.760453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.760689 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.760913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.761085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.761243 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.761398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.761556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.761702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.761844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.761995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.762137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.762326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.762471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.762624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.762768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.762926 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.763138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.763300 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.763443 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.763591 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.763742 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.763895 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.764048 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.764198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.764350 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-2-iscsi {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.764496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.764635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.764776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.764933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.765088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.765240 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.765383 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.765530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.765679 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.765835 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.765978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.766118 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.766290 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.766444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.768913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.768913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.769695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.770397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.770567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.770714 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.770864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.771016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.771221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.771386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.771541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.771693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.771852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.772007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.772161 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.772303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.772453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.772603 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.772744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.772893 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.773042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.773193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.773353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.773496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.773496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.773786 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-2-iscsi {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.773929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.774080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.774231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.774422 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.774575 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.774785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.774930 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.775088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.775420 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.775582 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.775734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.775875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.776035 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.776176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.776327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.776481 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.776634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.776775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.776922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.777074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.777223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.777386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.777530 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.777679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.777823 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.777962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.778109 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.778259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.778402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.778402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.778402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.778797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.778953 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.779185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.779538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.779696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.779847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.780515 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.780685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.780839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.780989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.781138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.781280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.781421 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.781575 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.781716 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.781865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.782028 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.782178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.782325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.782486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.782638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.782790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.782931 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.783102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.783262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.783605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.783752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.783913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.784054 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.784195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.784344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.784486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.784634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.784777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.784924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.785075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.785224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.785373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.785522 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.785522 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.785799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.785950 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.786099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.786254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.786396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.786570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.786711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.786867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.787009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.788305 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.788475 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.788629 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.788786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.788943 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.789094 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.789243 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.789411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.789723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.789922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.790884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.791072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.791235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.791388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.791531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.791988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.792151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.792293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.792433 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.792588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.792876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.793046 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.793199 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.793349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.793491 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.793645 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.793795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.793944 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.794092 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.794253 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.794404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.794552 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.794700 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.794841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.794981 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.795153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.795332 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.795901 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.796060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.796211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.796363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.796505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.796669 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.796821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.796970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.797111 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.797257 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.797402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.797402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.797402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.797823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.797966 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.798106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.798261 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.798417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.798566 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.798707 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.798855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.799002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.799282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.799429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.799703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.799929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.800087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.800229 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.800397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.801038 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.801211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.801355 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.801497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.801644 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.801795 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.801936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.802085 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.802225 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.802376 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.802532 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.802676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.802824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.802973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.803228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.803374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.803513 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.803655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.803802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.803957 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.804098 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.804246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.804396 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.804537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.804677 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.804830 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.804971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.805129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.805277 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.805418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.805622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.805780 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.805932 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.806075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.806215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.806354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.806507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.806648 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.806789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.806939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.807155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.807308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.807463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.807605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.807752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.807902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.808044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.808184 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.808337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.808487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.808635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.808782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.808942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.809091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.809248 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.809389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.809535 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.809807 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.810042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.810199 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.810349 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.810498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.811215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.811384 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.811527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.811693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.811843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.811993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.811993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.812278 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:05:58.812421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.812570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.812711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.812859 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.813002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.813149 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.813289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.813437 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.813596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.813745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.813888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.814028 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.814178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.814178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.814442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.814581 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.814729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.814878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.815032 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.815222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.815385 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.815527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.815674 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.815814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.815961 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.816102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.816251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.816401 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.816549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.816697 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.816852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817156 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817316 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817456 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.817878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.818256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.818420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.818577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.818726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.818874 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.819021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.819185 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.819337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.819490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.819638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.819913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.819913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.820289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.820437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.820589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.820739 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.821551 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.821708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.821859 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.822016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.822169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.822312 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.822460 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.822611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.822753 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.822902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.823085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.823235 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.823375 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.823516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.823666 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.823817 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.823978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.824127 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.824267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.824415 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.824563 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.824713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.824854 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.824994 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.825134 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.825281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.825435 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.825576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.825724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.825890 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.826038 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.826186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.826341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.826489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.826644 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.826799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.826946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.827124 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.827292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.827441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.827595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.827744 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.827910 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.828066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.828225 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.828373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.828544 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.828747 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.828904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.829062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.829062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.829351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.829499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.829645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.829802 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.830093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.830272 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.830499 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.830652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.830800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.830965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.831760 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.832044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.832044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.832340 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.832498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.832652 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.832824 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.832974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.833121 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.833275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.833423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.833578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.833733 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.833888 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.834037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.834208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.834357 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.834518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.834666 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.834823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.834971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.835223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.835405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.835572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.835721 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.835868 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.836015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.836170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.836319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.836549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.836700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.836879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.837051 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.837204 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.837360 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.837508 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.837655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.837800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.837958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.838113 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.838275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.838429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.838577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.838722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.838896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.839060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.839234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.839234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.839525 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.839680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.839828 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.839828 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.840254 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.840420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.840653 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.840816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.840974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.841145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.841644 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.841977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.842220 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.842384 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.842534 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.842691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.842840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.842987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.843193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.843344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.843492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.843656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.843816 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.843979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.844128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.844284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.844432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.844658 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.844817 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.844974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.845130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.845279 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.845440 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.845596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.845751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.845917 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.846066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.846228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.846426 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.846591 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.846747 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.846901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.847075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.847228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.847394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.847552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.847712 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.847879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.848037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.848198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.848353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.848508 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.848658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.848658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.848937 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.849097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.849097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.849393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.849547 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.849702 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.849863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.850019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.850224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.850453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.850607 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.850844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.850999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.851194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.851354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.851801 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.852157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.852444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.852603 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.852780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.852931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.853078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.853234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.853389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.853547 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.853695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.853929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.854095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.854253 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.854408 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.854566 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.854714 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.854872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.855020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.855189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.855354 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.855516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.855665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.855812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.855958 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.856112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.856269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.856426 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.856582 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.856731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.856731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.857042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.857042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.857443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.857593 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.857740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.857888 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.858052 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.858214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.858379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.858526 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.858672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.858838 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.859002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.859237 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.859388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.859543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.859692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.859846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.860004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.860165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.860357 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.860604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.860783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.861025 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.861202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.861353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.861501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.861501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.862082 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.862356 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.862674 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.862834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.862983 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.863154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.863315 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.863473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.863794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.863949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.864097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.864243 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.864399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.864562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.864711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.864872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.865019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.865164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.865324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.865481 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.865637 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.865803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.865973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.866121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.866277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.866277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.866277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.866710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.866874 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.867154 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.867336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.867489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.867645 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.867812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.868000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.868226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.868395 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.868544 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.868700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.868858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.869023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.869181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.869337 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.869494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.869642 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.869796 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.869963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.870133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.870324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.870477 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.870727 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.870890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.871100 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.871336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.871499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.871648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.872064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.872224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.872224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.872826 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.872991 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.873150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.873150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.873440 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.873602 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.873751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.873907 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.874055 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.874210 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.874358 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.874514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.874663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.874820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.874977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.875158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.875319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.875476 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.875643 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.875792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.875949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.876097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.876259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.876489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.876641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.876808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.876957 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.877112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.877270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.877429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.877579 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.877725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.877873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.878037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.878194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.878343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.878497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.878497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.878805 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.878973 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.879162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.879162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.879442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.879597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.879752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.879911 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.880068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.880225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.880425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.880589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.880589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.880969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.881129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.881279 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.881526 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.881687 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.881837 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.882270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.882422 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.882668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.882989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.883164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.883342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.883342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.883720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.883885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.884035 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.884182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.884341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.884489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.884649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.884805 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.884966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.885122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.885291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.885291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.885575 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.885732 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.885881 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886174 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886320 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886468 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.886633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.887284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.887444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.887608 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.887757 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.887904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.888050 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.888050 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.888336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.888493 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.888643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.888797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.888955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.889111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.889278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.889426 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.889574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.889721 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.889868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.890013 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.890169 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.890316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.890515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.890686 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.890854 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.891106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.891279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.891442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.891682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.891846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.892279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.892441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.892441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.892856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.893297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.893449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.893611 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.893771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.893920 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.894078 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.894226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.894390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.894548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.894705 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.894855 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.895010 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.895193 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.895352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.895500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.895647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.895795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.895943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.896099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.896264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.896421 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.896574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.896732 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.896888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.897037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.897193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.897341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.897497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.897653 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.897808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.897808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.898179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.898339 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.898494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.898494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.898775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.898775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.898775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.899291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.899454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.899603 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.899756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.899913 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.900071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.900230 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.900378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.900565 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.900728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.900888 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.901045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.901295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.901450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.901597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.901829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.901993 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.902413 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.902603 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.902755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.903009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.903286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.903538 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.903700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.903857 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.904005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.904161 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.904319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.904474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.904631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.904780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.904945 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.905094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.905250 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.905400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.905547 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.905703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.905851 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.906014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.906171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.906337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.906492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.906643 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.906809 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.906977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.907163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.907324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.907473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.907628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.907628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.907924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.908081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.908238 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.908398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.908550 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.908696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.908857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.909015 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.909182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.909330 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.909487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.909635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.909793 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.909948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.910103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.910250 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.910406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.910565 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.910754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.910926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.911094 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.911277 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.911507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.911673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.911842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.912058 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.912474 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.912645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.912804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.912962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.913214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.913456 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.913715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.913871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.914029 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.914178 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.914333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.914481 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.914630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.914777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.914989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.915174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.915334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.915334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.915666 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.915869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.916033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.916033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.916332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.916332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.916332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.917094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.917259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.917414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.917570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.917724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.917724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.918027 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.918184 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.918331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.918584 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.918738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.918892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.919148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.919316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.919466 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.919612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.919759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.919909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.920066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.920231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.920388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.920535 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.920734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.920889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.921049 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.921205 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.921363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.921527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.921752 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.921927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.922096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.923441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.923707 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.924002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.924214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.924390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.924570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.924726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.924889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.925046 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.925203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.925352 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.925507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.925687 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.925851 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.926009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.926164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.926320 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.926471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.926619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.926776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.926934 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.927195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.927353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.927501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.927660 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.927836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.927992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.928140 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.928287 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.928443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.928607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.928765 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.928912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.929067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.929222 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.929370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.929530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.929689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.929837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.929991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.930148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.930302 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.930568 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.930832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.931068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.931226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.931226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.931529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.931687 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.931955 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.932131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.932307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.932867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.933040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.933190 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.933338 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.933624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.933888 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.934463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.934632 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.934785 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.934941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.935120 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.935303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.935454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.935777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.935931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.935931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.935931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.936366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.936542 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.936694 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.936898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.937052 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.937211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.937359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.937535 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.937685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.937833 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.937980 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.938135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.938283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.938440 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.938589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.938736 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.938883 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.939039 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.939251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.939431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.939596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.939746 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.939909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.940066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.940224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.940374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.940530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.940686 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.940834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.941040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.941200 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.941349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.941349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.941654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.941654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.941953 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.942192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.942346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.942346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.942987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.943166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.943331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.943482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.943647 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.943895 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.944138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.944292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.944471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.944704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.944857 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.945012 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.945162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.945309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.945476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.945625 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.945773 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.945920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.946109 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.946341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.946551 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.946714 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.946865 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.947011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.947181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.947343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.947492 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.947647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.947795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.947942 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.948089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.948261 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.948411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.948557 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.948713 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.948861 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.949007 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.949167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.949316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.949464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.949619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.949775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.949933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.950099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.950245 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.950398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.950544 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.950707 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.950865 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.951097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.951264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.951414 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.951568 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.951724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.951886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952042 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.952596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.954874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.956064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.957203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.958357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.959573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.960697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.962073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.963833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.963833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.963833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.963833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.963833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.963833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.963833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.964887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.964887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.964887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.964887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.964887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.964887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.964887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.965882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.967016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.968208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.969414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.970622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.971871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.971871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.971871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.971871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.971871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.971871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.971871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.973081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.973081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.973081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.973081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.973928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.973928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.973928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.974410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.974601 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.974749 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.975027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.975357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.975668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.975974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.976288 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.976595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.976908 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.977215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.978039 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.978366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.978699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.979014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.979400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.979724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.980040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.980366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.980682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.980994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.981345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.981663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.982203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.982540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.982937 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.983234 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.983681 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.983996 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.984305 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.984614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.984941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.985255 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.985565 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.985876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.986193 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.986699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.986847 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.987133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.987447 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.987761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.988073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.988385 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.988704 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.989014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.989324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.989641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.989987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.990304 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.990622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.990871 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO dbcounter [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Registered counter for database nova_api Aug 24 11:05:58.991027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.991307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.991587 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.991897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.992207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.992517 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.992833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.993581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.993890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.994205 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.994634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.994948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.995295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.995618 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.995930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.996286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.996579 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.997254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.997592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.998038 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.998375 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.998719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.999171 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:58.999728 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.000158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.000473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.000781 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.001096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.001418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.001863 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.002179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.002486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.002801 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.003131 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.003494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.004180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.004743 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.005369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.006131 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.006573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.007075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.007657 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.008239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.008834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.009419 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.010014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.010427 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.010799 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.011190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.011515 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.011949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.012447 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.012848 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.012970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_db.sqlalchemy.engines [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.013227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.013907 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.014368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.014935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.015403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.015891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.016476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.017059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.017628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.018158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.018494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.018827 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.019185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.019519 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.020087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.020695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.021209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.021336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writer thread running {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.021585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.021931 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.022501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.022870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.023265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.023592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.023936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.025163 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.025480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.025882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.026214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.026569 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.026899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.027248 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.027571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.027896 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.028221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.028553 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.028887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.029206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.029542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.029873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.030233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.030543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.030900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.031261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.031582 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.031899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.032212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:05:59.032455 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:05:59.082561 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.context [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f543127f-8947-4c5e-9781-e6e09b81ac8e(cell1) {{(pid=120789) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:05:59.086655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:59.087326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:59.088896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:59.089623 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:59.090070 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:59.092082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:59.094112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO dbcounter [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Registered counter for database nova_cell0 Aug 24 11:05:59.096369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Registered counter for database nova_api Aug 24 11:05:59.098800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO dbcounter [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Registered counter for database nova_cell1 Aug 24 11:05:59.107147 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_db.sqlalchemy.engines [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.110906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_db.sqlalchemy.engines [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.117605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writer thread running {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.118648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.119260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writer thread running {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.126078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.184222 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.context [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f543127f-8947-4c5e-9781-e6e09b81ac8e(cell1) {{(pid=120788) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:05:59.188276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:59.188790 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:59.190372 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:59.191102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:05:59.191580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:05:59.193541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:05:59.195656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Registered counter for database nova_cell0 Aug 24 11:05:59.200641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Registered counter for database nova_cell1 Aug 24 11:05:59.208246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.210838 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.218606 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.219895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.267642 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO dbcounter [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Registered counter for database nova_cell0 Aug 24 11:05:59.275288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_db.sqlalchemy.engines [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.280116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writer thread running {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.372911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO dbcounter [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Registered counter for database nova_cell0 Aug 24 11:05:59.380087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_db.sqlalchemy.engines [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:05:59.385847 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writer thread running {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:05:59.602251 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: WARNING keystonemiddleware.auth_token [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:05:59.609910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: WARNING keystonemiddleware.auth_token [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:05:59.711280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:05:59.719252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:05:59.956261 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: WARNING keystonemiddleware.auth_token [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:05:59.962437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: WARNING keystonemiddleware.auth_token [None req-7d1a2d35-39f9-4bb9-ab67-b04ebfca3a9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:05:59.967976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c2cbce99c0 pid: 120789 (default app) Aug 24 11:06:00.082443 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:06:00.089099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: WARNING keystonemiddleware.auth_token [None req-7eea8bd4-e33e-4f92-83d8-400b3626ca91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:06:00.094412 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2cbce99c0 pid: 120788 (default app) Aug 24 11:06:36.191112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:36.191991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:36.193251 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:36.194870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:38.085499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9f4f16c7-dda9-4294-b9db-1cbd6a69fc21 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Action: 'create', calling method: .version_select at 0x7f82b81e35e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1715565493", "metadata": {"Type": "work"}}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9f4f16c7-dda9-4294-b9db-1cbd6a69fc21 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Request method failure captured: Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 122 Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgY8OpUQcpAb-WexPv6YP01rZ1ICaU-dghDNwi4GJVDCDXnGu094eT-rV6bsd23y2mRh_AN9Wqo2SakQhlkT6FHYwKuIvbqFZR8CyoRR2MU7u6lexPLb3asFvOt9ps_8eiQd3IM2UzM6XByEHA6HTedf-xcUSrLJ1HwcmQsomziDw2Q Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:06:38.092203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ecf0f1bbe1454976bca690b3b794be33", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 38e79ba5eafe4063ad18b993ec92934e Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1715565493", "metadata": {"Type": "work"}}} Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: Aug 24 11:06:38.093928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1715565493', 'metadata': {'Type': 'work'}}}} Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:38.094924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:06:38.096577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:06:38.097942 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:06:38.097942 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.103238 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9f4f16c7-dda9-4294-b9db-1cbd6a69fc21 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:38.125284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9f4f16c7-dda9-4294-b9db-1cbd6a69fc21 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.937147 Aug 24 11:06:38.132995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 24 11:06:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1949 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:06:38.137752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:38.138878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:38.139663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:38.142514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:06:38.547875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c90ad57b-5bc3-42af-bcf8-650c9ba1a253 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Action: 'create', calling method: .version_select at 0x7f82b822d280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-15217402", "metadata": {"Type": "work"}}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c90ad57b-5bc3-42af-bcf8-650c9ba1a253 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Request method failure captured: Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 118 Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgY8OpUQcpAb-WexPv6YP01rZ1ICaU-dghDNwi4GJVDCDXnGu094eT-rV6bsd23y2mRh_AN9Wqo2SakQhlkT6FHYwKuIvbqFZR8CyoRR2MU7u6lexPLb3asFvOt9ps_8eiQd3IM2UzM6XByEHA6HTedf-xcUSrLJ1HwcmQsomziDw2Q Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:06:38.554571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ecf0f1bbe1454976bca690b3b794be33", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 38e79ba5eafe4063ad18b993ec92934e Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-15217402", "metadata": {"Type": "work"}}} Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: Aug 24 11:06:38.556429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-15217402', 'metadata': {'Type': 'work'}}}} Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi '0' Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:38.557215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:06:38.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:06:38.559737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:06:38.559737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.562033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c90ad57b-5bc3-42af-bcf8-650c9ba1a253 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:38.563611 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c90ad57b-5bc3-42af-bcf8-650c9ba1a253 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.430868 Aug 24 11:06:38.564731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 1/2] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 24 11:06:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 433 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:06:38.582315 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ae565b01-dfd5-43b4-aca4-4c5336155c56 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Action: 'create', calling method: .version_select at 0x7f82b81e3670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2118805775", "metadata": {"Type": "work"}}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ae565b01-dfd5-43b4-aca4-4c5336155c56 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Request method failure captured: Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 119 Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgY8OpUQcpAb-WexPv6YP01rZ1ICaU-dghDNwi4GJVDCDXnGu094eT-rV6bsd23y2mRh_AN9Wqo2SakQhlkT6FHYwKuIvbqFZR8CyoRR2MU7u6lexPLb3asFvOt9ps_8eiQd3IM2UzM6XByEHA6HTedf-xcUSrLJ1HwcmQsomziDw2Q Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:06:38.594116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ecf0f1bbe1454976bca690b3b794be33", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 38e79ba5eafe4063ad18b993ec92934e Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2118805775", "metadata": {"Type": "work"}}} Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: Aug 24 11:06:38.595902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2118805775', 'metadata': {'Type': 'work'}}}} Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi '' Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:38.596685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:06:38.599434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:06:38.601927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:06:38.601927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:38.604251 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ae565b01-dfd5-43b4-aca4-4c5336155c56 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:38.606423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ae565b01-dfd5-43b4-aca4-4c5336155c56 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033879 Aug 24 11:06:38.613089 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 24 11:06:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:06:38.617643 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02950624-eb34-4be7-afaa-6d44514ff6b4 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Calling method '.version_select at 0x7f82b822de50>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:39.093794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-02950624-eb34-4be7-afaa-6d44514ff6b4 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] HTTP exception thrown: Volume tempest-invalid-1927206928 could not be found. Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02950624-eb34-4be7-afaa-6d44514ff6b4 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Request method failure captured: Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1927206928 HTTP/1.1 Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgY8OpUQcpAb-WexPv6YP01rZ1ICaU-dghDNwi4GJVDCDXnGu094eT-rV6bsd23y2mRh_AN9Wqo2SakQhlkT6FHYwKuIvbqFZR8CyoRR2MU7u6lexPLb3asFvOt9ps_8eiQd3IM2UzM6XByEHA6HTedf-xcUSrLJ1HwcmQsomziDw2Q Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:06:39.097893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ecf0f1bbe1454976bca690b3b794be33", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 38e79ba5eafe4063ad18b993ec92934e Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Volume tempest-invalid-1927206928 could not be found. Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'tempest-invalid-1927206928'} Aug 24 11:06:39.099217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1927206928 could not be found. (HTTP 404) (Request-ID: req-cb454120-529d-4910-9ada-5954ec7f795a) Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.099977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:06:39.101170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1927206928 could not be found. Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:06:39.102724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1927206928 could not be found. Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1927206928 could not be found. Aug 24 11:06:39.103901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.105835 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02950624-eb34-4be7-afaa-6d44514ff6b4 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Returning 404 to user: Volume tempest-invalid-1927206928 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:39.107138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-02950624-eb34-4be7-afaa-6d44514ff6b4 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1927206928" status: 404 len: 99 microversion: 2.1 time: 0.494069 Aug 24 11:06:39.107674 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1218 bytes} [Wed Aug 24 11:06:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1927206928 => generated 99 bytes in 496 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:06:39.121515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-61204a4f-adf4-49f8-9e1c-cb6e1ccf1d04 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007832 Aug 24 11:06:39.129350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 3/5] 10.222.0.79 () {58 vars in 1140 bytes} [Wed Aug 24 11:06:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:06:39.142678 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-409e8ef7-7bc0-4bc1-8eb0-708dd1db302c tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011733 Aug 24 11:06:39.159200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-da13e67a-4de2-46bc-b306-b630e09f6881 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Calling method '.version_select at 0x7f82b811a430>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:39.162900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 3/6] 10.222.0.79 () {58 vars in 1137 bytes} [Wed Aug 24 11:06:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:06:39.686883 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-da13e67a-4de2-46bc-b306-b630e09f6881 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] HTTP exception thrown: Volume 43d1e09e-1cdb-46f4-b794-fa863a8ea682 could not be found. Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-da13e67a-4de2-46bc-b306-b630e09f6881 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Request method failure captured: Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: DELETE /compute/v2.1/os-volumes/43d1e09e-1cdb-46f4-b794-fa863a8ea682 HTTP/1.1 Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgY8OpUQcpAb-WexPv6YP01rZ1ICaU-dghDNwi4GJVDCDXnGu094eT-rV6bsd23y2mRh_AN9Wqo2SakQhlkT6FHYwKuIvbqFZR8CyoRR2MU7u6lexPLb3asFvOt9ps_8eiQd3IM2UzM6XByEHA6HTedf-xcUSrLJ1HwcmQsomziDw2Q Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:06:39.690655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ecf0f1bbe1454976bca690b3b794be33", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 38e79ba5eafe4063ad18b993ec92934e Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Volume 43d1e09e-1cdb-46f4-b794-fa863a8ea682 could not be found. Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '43d1e09e-1cdb-46f4-b794-fa863a8ea682'} Aug 24 11:06:39.692047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43d1e09e-1cdb-46f4-b794-fa863a8ea682 could not be found. (HTTP 404) (Request-ID: req-71b2b2d5-c100-4f0a-bf69-eab354f6de91) Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.692868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:06:39.694005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43d1e09e-1cdb-46f4-b794-fa863a8ea682 could not be found. Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:06:39.697486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43d1e09e-1cdb-46f4-b794-fa863a8ea682 could not be found. Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43d1e09e-1cdb-46f4-b794-fa863a8ea682 could not be found. Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-da13e67a-4de2-46bc-b306-b630e09f6881 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Returning 404 to user: Volume 43d1e09e-1cdb-46f4-b794-fa863a8ea682 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:39.700756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-da13e67a-4de2-46bc-b306-b630e09f6881 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/43d1e09e-1cdb-46f4-b794-fa863a8ea682" status: 404 len: 109 microversion: 2.1 time: 0.538041 Aug 24 11:06:39.702949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-390d1108-176d-4af9-809c-c5fe46563004 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Calling method '.version_select at 0x7f82b809fdc0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:39.712675 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:06:39 2022] DELETE /compute/v2.1/os-volumes/43d1e09e-1cdb-46f4-b794-fa863a8ea682 => generated 109 bytes in 559 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:06:39.741768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-390d1108-176d-4af9-809c-c5fe46563004 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] HTTP exception thrown: Volume a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 could not be found. Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-390d1108-176d-4af9-809c-c5fe46563004 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Request method failure captured: Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/os-volumes/a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 HTTP/1.1 Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgY8OpUQcpAb-WexPv6YP01rZ1ICaU-dghDNwi4GJVDCDXnGu094eT-rV6bsd23y2mRh_AN9Wqo2SakQhlkT6FHYwKuIvbqFZR8CyoRR2MU7u6lexPLb3asFvOt9ps_8eiQd3IM2UzM6XByEHA6HTedf-xcUSrLJ1HwcmQsomziDw2Q Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:06:39.744431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ecf0f1bbe1454976bca690b3b794be33", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ecf0f1bbe1454976bca690b3b794be33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: ecf0f1bbe1454976bca690b3b794be33 Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesNegativeTest-1176502136 Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 38e79ba5eafe4063ad18b993ec92934e Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesNegativeTest-1176502136-project Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Volume a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 could not be found. Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0'} Aug 24 11:06:39.745785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 could not be found. (HTTP 404) (Request-ID: req-5158dfff-40d3-44a0-b7eb-f2b7a526dc03) Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.746683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:06:39.748894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 could not be found. Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:06:39.751019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 could not be found. Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 could not be found. Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-390d1108-176d-4af9-809c-c5fe46563004 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] Returning 404 to user: Volume a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-390d1108-176d-4af9-809c-c5fe46563004 tempest-VolumesNegativeTest-1176502136 tempest-VolumesNegativeTest-1176502136-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0" status: 404 len: 109 microversion: 2.1 time: 0.052178 Aug 24 11:06:39.753541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:06:39 2022] GET /compute/v2.1/os-volumes/a4e535ec-ca36-44a2-b1c4-7bac0a5a8aa0 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:06:39.927166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0d54775e-97cc-497f-9ad7-b21b147a76fa tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b804e040>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:40.003582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0d54775e-97cc-497f-9ad7-b21b147a76fa tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/0363791a-cbef-40a9-b93b-72d374863474" status: 200 len: 351 microversion: 2.1 time: 0.080661 Aug 24 11:06:40.004455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 5/9] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:06:39 2022] GET /compute/v2.1/os-volumes/0363791a-cbef-40a9-b93b-72d374863474 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:41.799607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a07e5991-164e-4f8a-97c8-2823291d269a tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b80499d0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:41.857903 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a07e5991-164e-4f8a-97c8-2823291d269a tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/549e4994-bebd-4333-a466-767ebdc8a373" status: 200 len: 351 microversion: 2.1 time: 0.062021 Aug 24 11:06:41.858802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 5/10] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:06:41 2022] GET /compute/v2.1/os-volumes/549e4994-bebd-4333-a466-767ebdc8a373 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:43.668356 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cc72aa97-951d-422e-9389-b9b932f10b0b tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b804e790>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:43.840371 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cc72aa97-951d-422e-9389-b9b932f10b0b tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/66a314f5-8e59-4c82-a253-b43ad36d4e81" status: 200 len: 350 microversion: 2.1 time: 0.178428 Aug 24 11:06:43.841021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 6/11] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:06:43 2022] GET /compute/v2.1/os-volumes/66a314f5-8e59-4c82-a253-b43ad36d4e81 => generated 350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:43.854497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-39160d29-3416-4202-97be-9528563539a0 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b809fca0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:44.115151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-39160d29-3416-4202-97be-9528563539a0 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.263793 Aug 24 11:06:44.118139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1134 bytes} [Wed Aug 24 11:06:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:44.131324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6040519c-9cc1-4a17-b3a7-f8baf0926242 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b804eb80>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:44.427632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6040519c-9cc1-4a17-b3a7-f8baf0926242 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.300669 Aug 24 11:06:44.439926 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1149 bytes} [Wed Aug 24 11:06:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:44.446504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-78485210-d6d1-4229-a38e-9165a89535c6 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b8049160>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:44.736815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-78485210-d6d1-4229-a38e-9165a89535c6 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.297068 Aug 24 11:06:44.737388 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 7/14] 10.222.0.79 () {58 vars in 1134 bytes} [Wed Aug 24 11:06:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:44.752442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d8c20311-907a-4e4d-a140-2ef493da32f9 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b805a1f0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:44.955063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d8c20311-907a-4e4d-a140-2ef493da32f9 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.206364 Aug 24 11:06:44.966324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 8/15] 10.222.0.79 () {58 vars in 1167 bytes} [Wed Aug 24 11:06:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:44.972648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0f317f04-3d49-400c-8180-384ba2252fe6 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b8051ee0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:45.188752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0f317f04-3d49-400c-8180-384ba2252fe6 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.221473 Aug 24 11:06:45.189745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 8/16] 10.222.0.79 () {58 vars in 1170 bytes} [Wed Aug 24 11:06:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:06:45.205466 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4448cfbe-ecd8-4fca-9b30-de089586fe3a tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b805ab80>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:45.495438 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4448cfbe-ecd8-4fca-9b30-de089586fe3a tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.294559 Aug 24 11:06:45.496447 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 9/17] 10.222.0.79 () {58 vars in 1155 bytes} [Wed Aug 24 11:06:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:45.526154 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b6ccfb5b-4905-4db1-9dc5-0d47720ade62 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b8049ee0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:45.820448 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b6ccfb5b-4905-4db1-9dc5-0d47720ade62 tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.301968 Aug 24 11:06:45.820448 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 9/18] 10.222.0.79 () {58 vars in 1188 bytes} [Wed Aug 24 11:06:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:45.833560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2b951da4-f1ee-4d14-b516-94a8a2daa59f tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] Calling method '.version_select at 0x7f82b804e3a0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:45.987750 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2b951da4-f1ee-4d14-b516-94a8a2daa59f tempest-VolumesTestJSON-601116329 tempest-VolumesTestJSON-601116329-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.158413 Aug 24 11:06:45.988659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 10/19] 10.222.0.79 () {58 vars in 1155 bytes} [Wed Aug 24 11:06:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:50.337899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-666860029", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "networks": [{"uuid": "e315b2ce-9b91-4147-be92-331fa6f6f13d"}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:50.534871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] validate_networks() for [('e315b2ce-9b91-4147-be92-331fa6f6f13d', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:06:52.389576 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:06:52.393418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:06:52.399034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:06:52.399927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:06:52.400480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:06:52.447123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:52.448111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:52.448837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:52.451325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:52.453441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:52.455203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:52.525601 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Getting quotas for project 57f9ef57fb3e4440b0f404cb757c5579. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:06:52.547173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Getting quotas for user 65475998205f4120bcdfc10fd0aada7a and project 57f9ef57fb3e4440b0f404cb757c5579. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:06:52.571701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:06:52.582832 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:06:52.886496 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fb293dcd-877f-4b5f-8391-990f661808b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.857618 Aug 24 11:06:52.899811 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 10/20] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:06:52.900081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b8dc6cbe-d433-443f-8b91-0f7e4ee09128 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:52.901352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b8dc6cbe-d433-443f-8b91-0f7e4ee09128 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:53.109259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b8dc6cbe-d433-443f-8b91-0f7e4ee09128 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:53.125701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b8dc6cbe-d433-443f-8b91-0f7e4ee09128 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1214 microversion: 2.1 time: 0.230485 Aug 24 11:06:53.138797 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 11/21] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:52 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:53.728476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eabd8b41-8f4f-4700-aaa3-dc140a490214 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'create', calling method: .version_select at 0x7f82b7f5f0d0>, body: {"keypair": {"name": "tempest-keypair-1708317411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarQbxZeBS2VQWcSKTP7l4dBM53FdxZ+p68l2Wv/2w7F5SY8soz0WbKrTa/yk7nrbaoDnR586+tqPNpdZ0UiewzISUYSc8m4GWXvAUZEobs3Wp1D/PmCPph57UAw9avmQ=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:53.799962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-eabd8b41-8f4f-4700-aaa3-dc140a490214 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:06:53.811741 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-eabd8b41-8f4f-4700-aaa3-dc140a490214 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for user 28b3ce054ae04f8e9db0cdc3a13867e9 and project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:06:53.919511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eabd8b41-8f4f-4700-aaa3-dc140a490214 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.726985 Aug 24 11:06:53.920339 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 11/22] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:06:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:06:54.151189 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-34b67211-caaf-45d4-b67b-3f858ec1e8cb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:54.151816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-34b67211-caaf-45d4-b67b-3f858ec1e8cb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:54.184043 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1143199550", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:54.403414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-34b67211-caaf-45d4-b67b-3f858ec1e8cb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:54.444941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-34b67211-caaf-45d4-b67b-3f858ec1e8cb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1214 microversion: 2.1 time: 0.297060 Aug 24 11:06:54.447661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 12/23] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:54 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:54.480554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] validate_networks() for [('2e9af3f0-b723-450b-8a9b-1100f552e746', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:06:55.093418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-70c0e0b5-74b7-440c-a97f-c91524346822 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'create', calling method: .version_select at 0x7f82b6eed280>, body: {"keypair": {"name": "tempest-keypair-237646602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY5XG7KnQ/+XwkIqAgZP5LPFDBqtwEZo2+bYdDewwPj8TK68c3mXDcOSK/iIIU7Q/kxLtEbcemDsBSeBoYP3cVJgIVRRI83CEy4T6lO2IHVwldxspgRPEuy7DCe/PBsRA=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:55.128605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-70c0e0b5-74b7-440c-a97f-c91524346822 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:06:55.133417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-70c0e0b5-74b7-440c-a97f-c91524346822 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for user d53266f9532a4250bf4d1159621493a9 and project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:06:55.169737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-70c0e0b5-74b7-440c-a97f-c91524346822 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.278994 Aug 24 11:06:55.172153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 13/24] 10.222.0.79 () {62 vars in 1200 bytes} [Wed Aug 24 11:06:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 282 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 11:06:55.467020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cf3d2bc3-002b-43a8-b083-cf08ca12ef35 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:55.467770 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cf3d2bc3-002b-43a8-b083-cf08ca12ef35 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:55.615676 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cf3d2bc3-002b-43a8-b083-cf08ca12ef35 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:55.627374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cf3d2bc3-002b-43a8-b083-cf08ca12ef35 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1214 microversion: 2.1 time: 0.163998 Aug 24 11:06:55.628469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 14/25] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:55 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:06:56.349313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:06:56.349845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:06:56.349928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:06:56.350465 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:06:56.351037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:06:56.400248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:56.400768 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:56.401140 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:56.408492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:56.408492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:56.408492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:56.498856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for project 18b9988b1131422f9db644695c1df22d. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:06:56.529499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for user e808c04cd77d446ca2c05712868b7ce3 and project 18b9988b1131422f9db644695c1df22d. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:06:56.582997 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:06:56.586415 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:06:56.664554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:56.665800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:56.675549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:56.676608 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:56.680928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:56.682495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:56.685083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:56.686079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:56.768246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-be0b389e-134f-4ef2-81b0-71fe40d8cfce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.787422 Aug 24 11:06:56.769272 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 12/26] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:06:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:06:56.790128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7cd10daf-24d5-4a2e-8169-1faf2af58185 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:56.791359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7cd10daf-24d5-4a2e-8169-1faf2af58185 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:57.276291 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7cd10daf-24d5-4a2e-8169-1faf2af58185 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:57.304342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7cd10daf-24d5-4a2e-8169-1faf2af58185 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1222 microversion: 2.1 time: 0.523992 Aug 24 11:06:57.306048 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 13/27] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:56 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1222 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:57.404613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:06:57.432663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7f047c8e-f755-4ec9-a1e6-467567282452 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1274 microversion: 2.1 time: 0.772445 Aug 24 11:06:57.435014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 15/28] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:56 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1274 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:06:57.470465 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1310332128", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:06:57.638649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] validate_networks() for [('2e9af3f0-b723-450b-8a9b-1100f552e746', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:06:58.459812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:06:58.460634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:06:58.469343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:58.469854 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:58.470289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:06:58.470994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:06:58.471473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:06:58.473155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:01.098377 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:01.113176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f544d6e8-6bc7-40a6-a974-762c0d77d3a3 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 2.656903 Aug 24 11:07:01.119376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 16/29] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:06:58 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 2664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:01.598753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:07:01.599963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:07:01.600825 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:07:01.601565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:07:01.602358 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:07:01.609113 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1770089379", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd5d20ae-4f6b-4d40-8e79-dbb1adb53674"}], "security_groups": [{"name": "tempest-securitygroup--1910819781"}], "key_name": "tempest-keypair-237646602", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:01.624364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:01.631669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:01.635944 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:01.637558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:01.641451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:01.642657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:01.717728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for project 18b9988b1131422f9db644695c1df22d. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:07:01.731014 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for user e808c04cd77d446ca2c05712868b7ce3 and project 18b9988b1131422f9db644695c1df22d. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:07:01.761869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:07:01.765114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:07:01.938221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a1e7e020-ef79-4d96-9daa-5157d2cc4ff2 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.470536 Aug 24 11:07:01.941453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 14/30] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:06:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:07:01.964910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-801881fd-db8d-44ae-893b-230a2692023a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:01.978912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-801881fd-db8d-44ae-893b-230a2692023a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:02.203268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] validate_networks() for [('cd5d20ae-4f6b-4d40-8e79-dbb1adb53674', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:07:02.500746 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:02.606878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-801881fd-db8d-44ae-893b-230a2692023a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:02.615023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-801881fd-db8d-44ae-893b-230a2692023a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1222 microversion: 2.1 time: 0.665946 Aug 24 11:07:02.637132 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 15/31] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:01 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1222 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:02.653303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:02.653917 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:02.674324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:02.674819 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:02.675281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:02.683792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:02.684399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:02.685201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:04.206593 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:04.244238 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ed9e9797-70cf-4986-a7d3-2f8e494e2f68 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 1.606099 Aug 24 11:07:04.244828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 16/32] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:02 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:04.279232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1206220444", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c40a07f-d287-4976-935d-2900a6918b41"}], "security_groups": [{"name": "tempest-securitygroup--1666780539"}], "key_name": "tempest-keypair-1708317411", "user_data": "}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:04.962578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] validate_networks() for [('0c40a07f-d287-4976-935d-2900a6918b41', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:07:05.621019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=18 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:07.372630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:07:07.373207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:07:07.373663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:07:07.374143 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:07:07.374623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:07:07.390490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:07.408940 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:07.409504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:07.411962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:07.412528 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:07.415649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:07.481113 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:07:07.490927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for user d53266f9532a4250bf4d1159621493a9 and project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:07:07.524876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:07:07.527267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:07:07.668052 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aee53245-2a7e-4124-9443-f2e96fb1bf00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.073307 Aug 24 11:07:07.678743 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 17/33] 10.222.0.79 () {62 vars in 1188 bytes} [Wed Aug 24 11:07:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 6084 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 11:07:07.692376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:07.693392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:07.727389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:07.729646 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:07.734075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:07.734974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:07.735570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:07.736236 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:07.847771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:07:07.848399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:07:07.849006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:07:07.849662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:07:07.850171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:07:07.878651 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:07.887862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:07.888464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:07.889390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:07.891655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:07.892213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:07.949723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:07:07.956144 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for user 28b3ce054ae04f8e9db0cdc3a13867e9 and project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:07:08.001211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:07:08.001211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:07:08.178680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2d509c9a-dfdc-4942-b6e7-ae721f0205c3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.922303 Aug 24 11:07:08.187424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 17/34] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:07:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 3935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:07:08.192635 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:08.200171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:08.228664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:08.229407 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:08.229992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:08.240028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:08.247845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:08.249192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:08.253799 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:08.266091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c8989989-bef4-4184-bd69-ad1dd6e24c2f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1280 microversion: 2.1 time: 0.582674 Aug 24 11:07:08.267715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 18/35] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:07 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1280 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:08.488211 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-c0785ca4-d307-4789-ac84-0106edb8213e req-bc4de9e2-be49-4cba-8e28-9101835550c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a833b4-640b-4266-a7d9-0163551401c8", "tag": "9924d3d2-5b59-4069-a6f1-573cc73adf70"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:08.521356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c0785ca4-d307-4789-ac84-0106edb8213e req-bc4de9e2-be49-4cba-8e28-9101835550c5 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:08.521963 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c0785ca4-d307-4789-ac84-0106edb8213e req-bc4de9e2-be49-4cba-8e28-9101835550c5 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:08.522597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c0785ca4-d307-4789-ac84-0106edb8213e req-bc4de9e2-be49-4cba-8e28-9101835550c5 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:08.566021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-c0785ca4-d307-4789-ac84-0106edb8213e req-bc4de9e2-be49-4cba-8e28-9101835550c5 service nova] Creating event network-changed:9924d3d2-5b59-4069-a6f1-573cc73adf70 for instance e2a833b4-640b-4266-a7d9-0163551401c8 on hv-cinder-85427 Aug 24 11:07:08.566861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c0785ca4-d307-4789-ac84-0106edb8213e req-bc4de9e2-be49-4cba-8e28-9101835550c5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:07:08.567441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c0785ca4-d307-4789-ac84-0106edb8213e req-bc4de9e2-be49-4cba-8e28-9101835550c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:07:08.569607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:08.591671 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:08.592653 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:08.594022 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:08.594999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:08.597157 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:08.613338 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.compute.rpcapi [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:07:08.621564 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:07:08.696487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-21832feb-7f71-4c2a-994c-918d2522bdd1 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410078 Aug 24 11:07:08.706824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 19/36] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:08.738681 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-437ced91-06c0-4736-8274-09dca82e8e3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:08.743501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-437ced91-06c0-4736-8274-09dca82e8e3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:09.360076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-437ced91-06c0-4736-8274-09dca82e8e3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:09.375208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-437ced91-06c0-4736-8274-09dca82e8e3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:09.380993 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-437ced91-06c0-4736-8274-09dca82e8e3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:09.387498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-437ced91-06c0-4736-8274-09dca82e8e3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1281 microversion: 2.20 time: 0.672589 Aug 24 11:07:09.390815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 20/37] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:08 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1281 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:09.401478 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8c9847a5-b259-4eff-8446-0af4ee5445b5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:09.403246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8c9847a5-b259-4eff-8446-0af4ee5445b5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:09.934758 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8c9847a5-b259-4eff-8446-0af4ee5445b5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:09.951946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8c9847a5-b259-4eff-8446-0af4ee5445b5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1238 microversion: 2.1 time: 0.559785 Aug 24 11:07:09.969712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 21/38] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:09 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1238 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:09.981994 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:09.993340 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:09.998060 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-bece1785-656a-4916-849b-0027e35077e0 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 1.809162 Aug 24 11:07:09.998987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 18/39] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:08 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:10.001868 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:10.033145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:10.034720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:10.035954 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:10.040620 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:10.041212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:10.041890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:10.359619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:10.370041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7e18b92a-c37b-485e-b804-6cac3957af02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.401209 Aug 24 11:07:10.384613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 22/40] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:09 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:10.412790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:10.414077 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:10.431441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:10.432117 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:10.432718 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:10.434058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:10.435549 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:10.439766 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:10.740226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:10.761740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:10.769354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:10.773872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-71378480-d16a-497f-9aad-fde4cf2d69a6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1333 microversion: 2.20 time: 0.366659 Aug 24 11:07:10.776864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 19/41] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:10 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1333 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:10.979469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:10.980148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:10.998591 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:10.999198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:10.999651 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:11.005959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:11.006585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:11.009854 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:11.024890 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:11.026686 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:11.058549 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:11.062320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:11.066974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:11.073661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:11.077300 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:11.080143 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:11.248738 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:11.261707 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7fe27141-3211-4223-b78c-ae6535a6766b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1290 microversion: 2.1 time: 0.288057 Aug 24 11:07:11.262861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 23/42] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:10 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1290 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:11.397844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:11.399646 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:11.410864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:11.411550 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:11.411996 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:11.412781 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:11.414605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:11.421972 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:11.490494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:11.506990 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-56e28e5d-8d70-4ed3-8138-cf3312315973 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.486342 Aug 24 11:07:11.510602 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 20/43] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:11 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:11.724925 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:11.740683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-694fadc5-dc92-4bc9-9092-9ebd0f61fb21 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.354080 Aug 24 11:07:11.769859 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 24/44] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:11 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:11.817445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:11.821236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:11.845812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:11.850588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:11.852778 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:11.856231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:11.875351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:11.877626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:12.290716 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:12.291408 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:12.307268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:12.307768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:12.312731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:12.319033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:12.321725 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:12.322450 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:12.386377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:12.396209 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:12.407654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:12.408821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f433e680-8f32-444b-8c9a-8107ebc65666 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1339 microversion: 2.20 time: 0.602616 Aug 24 11:07:12.409402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 21/45] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:11 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1339 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:12.830370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-62205711-223a-4ee6-aacb-1e3d96641047 req-2b4a90e2-d4e3-41cd-866e-7a867786f981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02fe8ce-b37d-4d03-a1b1-3b434850514d", "tag": "3eb1fd1c-0294-4966-b482-f9a4c66d814b"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:12.873346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-62205711-223a-4ee6-aacb-1e3d96641047 req-2b4a90e2-d4e3-41cd-866e-7a867786f981 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:12.874172 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-62205711-223a-4ee6-aacb-1e3d96641047 req-2b4a90e2-d4e3-41cd-866e-7a867786f981 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:12.875366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-62205711-223a-4ee6-aacb-1e3d96641047 req-2b4a90e2-d4e3-41cd-866e-7a867786f981 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:12.919899 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-62205711-223a-4ee6-aacb-1e3d96641047 req-2b4a90e2-d4e3-41cd-866e-7a867786f981 service nova] Creating event network-changed:3eb1fd1c-0294-4966-b482-f9a4c66d814b for instance e02fe8ce-b37d-4d03-a1b1-3b434850514d on hv-cinder-85427 Aug 24 11:07:12.921531 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-62205711-223a-4ee6-aacb-1e3d96641047 req-2b4a90e2-d4e3-41cd-866e-7a867786f981 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120789) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:07:12.922267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-62205711-223a-4ee6-aacb-1e3d96641047 req-2b4a90e2-d4e3-41cd-866e-7a867786f981 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120789) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:07:12.923719 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:12.924364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:12.924927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:12.925774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:12.926362 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:12.926925 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:12.936314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.compute.rpcapi [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:07:12.937441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] Releasing lock "compute-rpcapi-router" {{(pid=120789) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:07:12.974972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4891b7fe-4c2e-4d76-9ae9-d171c819e03c None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485465 Aug 24 11:07:12.977180 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 22/46] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:07:12.987359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:12.988589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:13.003215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:13.007486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:13.009631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:13.011006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:13.012682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:13.015158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:13.032486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:13.046209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8af617ff-f058-445e-9ac0-e324a8cd4033 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1308 microversion: 2.1 time: 0.757397 Aug 24 11:07:13.055651 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 25/47] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:12 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:13.078006 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:13.084521 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:13.109830 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:13.110321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:13.110802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:13.129656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:13.130336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:13.131860 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:13.673023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:13.686642 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-33ed3112-310d-4cac-955a-f4e8423d9e27 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.707265 Aug 24 11:07:13.687263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 23/48] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:12 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:13.709665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:13.712936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:13.726819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:13.728420 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:13.729496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:13.730694 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:13.732160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:13.732783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:13.733424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:13.739523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-20522a92-f982-4e48-93c8-5b24a9127825 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.681580 Aug 24 11:07:13.740368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 26/49] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:13 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:13.870268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:13.889257 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:13.891609 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:13.893048 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cd87c186-7a80-4f1b-b32a-e7bb96c902fa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1339 microversion: 2.20 time: 0.192172 Aug 24 11:07:13.894176 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 24/50] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:13 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:14.067580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:14.068298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:14.077710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:14.090122 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:14.090577 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:14.091340 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:14.101755 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:14.104579 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:14.286613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:14.297484 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b393655a-4a08-45a3-8a3f-4451a82f3d59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1296 microversion: 2.1 time: 0.233972 Aug 24 11:07:14.298574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 27/51] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:14 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1296 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:14.711440 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:14.712047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:14.730506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:14.731064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:14.731497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:14.732198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:14.732649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:14.733069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:14.766619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:14.767338 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:14.778333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:14.779010 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:14.779656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:14.780646 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:14.783419 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:14.784837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.124951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.136274 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-dad2ee82-1dcf-4790-804b-740e27f69760 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.428461 Aug 24 11:07:15.137863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 25/52] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:14 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:15.148943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:15.153540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.162860 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5adeaa52-26b2-4300-949a-3217fb7bd3ba tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.402442 Aug 24 11:07:15.163393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:15.167332 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 28/53] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:14 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:15.173868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.177608 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-80a7a56e-16be-4d2c-8ced-39ad29e8fc53 req-2b2c6952-d167-40ad-9226-54ef4c141e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4f034f-a8a6-47f5-a6a6-f420a528333f", "tag": "1bc718d7-7c18-4093-b2ae-95110a425a49"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:15.179361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.180072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.183733 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.184624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.185469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.206693 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-80a7a56e-16be-4d2c-8ced-39ad29e8fc53 req-2b2c6952-d167-40ad-9226-54ef4c141e2c service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.207537 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-80a7a56e-16be-4d2c-8ced-39ad29e8fc53 req-2b2c6952-d167-40ad-9226-54ef4c141e2c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.208179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-80a7a56e-16be-4d2c-8ced-39ad29e8fc53 req-2b2c6952-d167-40ad-9226-54ef4c141e2c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.234421 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-80a7a56e-16be-4d2c-8ced-39ad29e8fc53 req-2b2c6952-d167-40ad-9226-54ef4c141e2c service nova] Creating event network-changed:1bc718d7-7c18-4093-b2ae-95110a425a49 for instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f on hv-cinder-85427 Aug 24 11:07:15.242881 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-80a7a56e-16be-4d2c-8ced-39ad29e8fc53 req-2b2c6952-d167-40ad-9226-54ef4c141e2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073000 Aug 24 11:07:15.243898 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 29/54] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:15.324398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:15.338190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:15.352858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:15.358502 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.359316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.360093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.360978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:15.361823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:15.362986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:15.407784 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.421808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.430093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.432096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5d6c6de6-d362-4222-b403-6898f6c148b7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.292948 Aug 24 11:07:15.433435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 26/55] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:15 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:15.624438 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:15.637929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-63ec4302-e95c-4726-b916-605f46fde064 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.319354 Aug 24 11:07:15.639338 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 30/56] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:15 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:16.158284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:16.160644 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:16.169295 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.170094 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.170815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.171751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.172286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.172826 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.193128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:16.195420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:16.204549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.205361 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.206435 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.208495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.208950 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.209516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.446615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.462017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7c3510ef-2fb7-4b14-b9b3-9a97045ecf54 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.267453 Aug 24 11:07:16.462712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 31/57] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:16 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:16.470107 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:16.470708 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:16.474932 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.478751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.479509 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.480091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.480998 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.481399 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.481912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.489518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-23abf02b-6220-4dc3-94d9-3c03ecd6c3a9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.336838 Aug 24 11:07:16.490102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 27/58] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:16 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:16.635307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.643737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.645248 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.646361 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-81b80b13-9655-4a85-9297-64fb0146d2dc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.180239 Aug 24 11:07:16.646916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 32/59] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:16 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:16.659146 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:16.660152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:16.667475 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.668028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.668656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.669350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:16.669886 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:16.670459 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:16.838192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:16.850647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b3a12f59-f46e-4e3f-9f93-f666db63cc95 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.194670 Aug 24 11:07:16.851852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 28/60] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:16 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:17.482259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:17.482859 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:17.489639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.490118 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.490539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.491237 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.491740 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.492210 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.514330 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:17.516102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:17.525661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.526572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.527378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.528693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.529988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.530708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.685333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:17.699212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-81de6c95-0ba2-4abd-a10c-2e5c6e8afc43 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.221140 Aug 24 11:07:17.711503 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 33/61] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:17 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:17.718317 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:17.718920 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:17.724957 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.725543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.725871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.726566 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.727012 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.727452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.737587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:17.746773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a5c1d880-7f65-4d86-a0a1-8f5e5572a8c7 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.238301 Aug 24 11:07:17.760095 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 29/62] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:17 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:17.865543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:17.869217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:17.875625 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:17.876028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:17.876846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:17.877810 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:17.879256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-282e2816-e23f-4e1a-9777-bba580fdc674 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.166511 Aug 24 11:07:17.879955 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 34/63] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:17 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:17.884203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.885296 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.885754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.886909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:17.887512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:17.887937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:17.968073 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=24 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:18.025576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:18.037406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8a9644bc-4e0e-491a-bbc7-3defc0276624 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.167977 Aug 24 11:07:18.038979 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 30/64] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:17 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:18.724501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:18.725133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:18.727475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:18.733326 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.733825 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.734257 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.734950 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.735428 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.735848 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.767594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:18.768188 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:18.774810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.775320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.775772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.776450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.776882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.777296 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.915226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:18.923500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3fa5d267-f519-4949-9f37-074af9103cb5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.203157 Aug 24 11:07:18.924667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 35/65] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:18 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:18.929856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:18.930561 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:18.936889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.937496 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.938041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.938820 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:18.939504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:18.940638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:18.945399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:18.953652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b02b29c5-8c92-4129-9c84-ed098f530c65 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.189776 Aug 24 11:07:18.954280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 31/66] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:18 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:19.059466 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:19.060061 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:19.066004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.066473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.066889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:19.067594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.068176 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.068594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:19.076289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:19.084696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:19.086927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:19.088072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e0d0b0ca-b517-4752-9f7b-6d4f4da3829c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.162125 Aug 24 11:07:19.088654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 36/67] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:18 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:19.390679 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:19.394288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:19.400690 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-28d213a5-dc6d-4511-86ae-2295cf5b9a11 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.345332 Aug 24 11:07:19.401552 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 32/68] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:19 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:19.944904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:19.946354 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:19.948936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=10 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:19.954850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.955295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.955702 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:19.956889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.957303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.957708 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:19.976598 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:19.977266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:19.983404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.983855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.984285 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:19.985319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:19.985898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:19.986785 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:20.218605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:20.231881 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:20.236321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e234abc5-0eb7-4c8c-8a6d-b92ab073738d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.295300 Aug 24 11:07:20.236932 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 37/69] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:19 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:20.252454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-43bc6b78-3e1f-4cca-8772-62fc8105c388 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.280300 Aug 24 11:07:20.254274 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 33/70] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:19 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:20.254495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:20.255390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:20.262151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:20.262821 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:20.263844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:20.264893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:20.265514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:20.266098 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:20.410651 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:20.420112 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:20.421943 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:20.423076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5dac9c42-3d47-41b3-911d-0e7192dac29b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.172585 Aug 24 11:07:20.425015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:20.426223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:20.434322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:20.434847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:20.435448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:20.435586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 38/71] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:20 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:20.436185 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:20.436652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:20.437226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:20.506307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-42b5c060-128b-4f72-9d88-89f9d9198602 req-d27967fd-ffc1-4642-bce3-bb7b7884be17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7358f8-2cd1-41ac-a439-4630ad8630bc", "tag": "3265d28a-dfe5-435c-80d8-88ded1a20382"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:20.518301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-42b5c060-128b-4f72-9d88-89f9d9198602 req-d27967fd-ffc1-4642-bce3-bb7b7884be17 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:20.518840 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-42b5c060-128b-4f72-9d88-89f9d9198602 req-d27967fd-ffc1-4642-bce3-bb7b7884be17 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:20.519370 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-42b5c060-128b-4f72-9d88-89f9d9198602 req-d27967fd-ffc1-4642-bce3-bb7b7884be17 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:20.542789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-42b5c060-128b-4f72-9d88-89f9d9198602 req-d27967fd-ffc1-4642-bce3-bb7b7884be17 service nova] Creating event network-changed:3265d28a-dfe5-435c-80d8-88ded1a20382 for instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc on hv-cinder-85427 Aug 24 11:07:20.548130 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-42b5c060-128b-4f72-9d88-89f9d9198602 req-d27967fd-ffc1-4642-bce3-bb7b7884be17 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046522 Aug 24 11:07:20.549406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 39/72] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:07:20.591965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:20.600032 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6e2553cc-0861-4d06-a1c6-bd2febcb3651 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.182087 Aug 24 11:07:20.600668 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 34/73] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:20 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:21.257556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:21.258249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:21.264709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.265187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.265617 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.266301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.266779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.267227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.284408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:21.285189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:21.292353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:21.294240 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.294922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.295427 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.296457 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.297327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.299899 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.477592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:21.486549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-02677adc-1e1b-4957-96d8-10231a530efb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.233325 Aug 24 11:07:21.487267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 40/74] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:21 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:21.492117 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:21.492777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:21.499424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.500096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.500741 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.501621 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.502094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.502507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.520997 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:21.529325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5c4cc7fe-e30a-494b-9883-cdeec7ccbedc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.249567 Aug 24 11:07:21.530002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 35/75] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:21 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:21.621114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:21.621721 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:21.630198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.631675 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.632945 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.635309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:21.636781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:21.639592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:21.644782 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:21.664440 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:21.669518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:21.670704 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-929295dc-23a6-4e8f-8f40-43590943c978 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.182448 Aug 24 11:07:21.671312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 41/76] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:21 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:21.814722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:21.824597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c3b49d97-a615-4f4b-8925-5f7cc6e45733 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.207510 Aug 24 11:07:21.825908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 36/77] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:21 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:22.510603 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:22.511232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:22.519473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.520051 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.520591 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.521617 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.522381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.522959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.549744 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:22.550290 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:22.556900 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.557383 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.557912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.558506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.558928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.559574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.706319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:22.714367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4eb746ea-c9f9-48ee-9192-07a7cf1b57e1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.208161 Aug 24 11:07:22.715027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 42/78] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:22 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:22.719624 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-710b147c-fb5f-4b6b-86fb-84d6346c6c0d req-fef7ef10-e363-485c-81ca-7e58f801f0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7140e32-0590-472a-a151-bd551fb262fe", "tag": "da8a304b-8b4f-4b24-acb2-ae0932287926"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:22.729087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-710b147c-fb5f-4b6b-86fb-84d6346c6c0d req-fef7ef10-e363-485c-81ca-7e58f801f0c9 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.729559 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-710b147c-fb5f-4b6b-86fb-84d6346c6c0d req-fef7ef10-e363-485c-81ca-7e58f801f0c9 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.729981 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-710b147c-fb5f-4b6b-86fb-84d6346c6c0d req-fef7ef10-e363-485c-81ca-7e58f801f0c9 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.733150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:22.740889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e0629cae-1611-480e-b946-734b7a1e3c97 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.194946 Aug 24 11:07:22.741252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-710b147c-fb5f-4b6b-86fb-84d6346c6c0d req-fef7ef10-e363-485c-81ca-7e58f801f0c9 service nova] Creating event network-changed:da8a304b-8b4f-4b24-acb2-ae0932287926 for instance c7140e32-0590-472a-a151-bd551fb262fe on hv-cinder-85427 Aug 24 11:07:22.741767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 37/79] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:22 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:22.746360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-710b147c-fb5f-4b6b-86fb-84d6346c6c0d req-fef7ef10-e363-485c-81ca-7e58f801f0c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030203 Aug 24 11:07:22.747106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 43/80] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:22.747212 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:22.747679 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:22.753764 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.754227 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.754655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.755366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.755812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.756226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.848252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:22.848934 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:22.857530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.857952 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.858376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.859074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:22.859488 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:22.860088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:22.897415 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:22.906200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:22.907735 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:22.908800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-de0e3986-fa83-45fa-8981-4770affb6269 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.166106 Aug 24 11:07:22.918222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 38/81] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:22 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:23.001274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:23.010192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f782ffae-fb22-468a-aa80-7f24fd7e305d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.165926 Aug 24 11:07:23.010785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 44/82] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:22 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:23.735615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:23.736164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:23.738047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=8 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:23.743812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:23.744390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:23.744822 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:23.745498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:23.745943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:23.746357 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:23.760909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:23.761595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:23.767725 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:23.768211 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:23.768636 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:23.769311 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:23.769764 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:23.770153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:24.138862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:24.146899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:24.149767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a7f1edd4-bcde-4c90-a4a8-ddfa1154ff02 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.418061 Aug 24 11:07:24.150494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 39/83] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:23 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:24.163015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:24.163015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:24.163015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:24.163015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:24.163530 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:24.164064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:24.164836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:24.165289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:24.167259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-78c24cbd-892c-41bf-b0b6-60747be6ae3c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.410352 Aug 24 11:07:24.168189 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 45/84] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:23 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:24.172773 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:24.173380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:24.179651 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:24.180156 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:24.180574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:24.181441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:24.181868 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:24.182303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:24.369340 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:24.376344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:24.377550 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:24.379072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:24.380234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4950d283-0133-4831-9a11-ce86094d6f6b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.228914 Aug 24 11:07:24.380790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 40/85] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:24 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:24.384476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-da876927-87b8-4696-b1f1-9dcc4336f16c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.215339 Aug 24 11:07:24.384979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 46/86] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:24 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:25.174481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:25.175356 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:25.182652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.183167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.183596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.184272 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.184721 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.185133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.188089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:25.188685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:25.194765 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.195280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.195699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.196373 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.196814 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.197221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.383411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:25.390629 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:25.391783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-87efc8ef-b196-4c45-aa3b-1cab6a2ef365 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.223887 Aug 24 11:07:25.392646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 41/87] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:25 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:25.399902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1350c93c-05e8-4a0b-8306-965b004f41fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.215498 Aug 24 11:07:25.400473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 47/88] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:25 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:25.401974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:25.402601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:25.408011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:25.408755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.408906 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:25.409209 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.409670 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.410352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.410764 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.411232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.416241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.416723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.417278 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.417971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:25.418420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:25.418838 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:25.595646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:25.606497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:25.608001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:25.609103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-07fd2e53-ee6f-44dc-bf6c-c7ff192b7b7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.211232 Aug 24 11:07:25.609655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 42/89] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:25 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:25.611468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:25.619844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-68677baa-0740-47dc-8450-14a22e702791 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.215457 Aug 24 11:07:25.620398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 48/90] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:25 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:26.416560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:26.417505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:26.423093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:26.423928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:26.426941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.427805 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.428546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.429215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.429698 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.430237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.431803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.432266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.432846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.433693 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.435972 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.435972 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.636018 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:26.639119 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:26.644706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c8938580-67fa-4534-891c-f2268c8356f5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.227058 Aug 24 11:07:26.645288 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 49/91] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:26 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:26.647344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fff9ce81-5df2-4fd5-8b5a-b32dcf5fe027 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.236833 Aug 24 11:07:26.649804 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:26.650394 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:26.653467 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 43/92] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:26 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:26.659085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.659609 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.660053 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.660515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:26.660765 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.661150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:26.661285 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.661572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.667727 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.668214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.668641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.669314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:26.669765 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:26.670344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:26.869491 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:26.874007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:26.881261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:26.882988 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:26.883782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2b83ea22-6e1c-4577-bbb4-6dbb93f21d03 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.229089 Aug 24 11:07:26.884122 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2f910f0d-8e8e-450f-9760-27fe0e9f85ff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.237966 Aug 24 11:07:26.884361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 44/93] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:26 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:26.884745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 50/94] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:26 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:27.667972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:27.668633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:27.669105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:27.669739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:27.675009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.675549 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.676006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.676597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.676704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.677106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.677231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.677724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.677844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.678468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.678926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.679410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.879484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:27.883228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:27.887375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3d59d8c6-5a60-4a18-97fc-a103cede5746 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.223899 Aug 24 11:07:27.888160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 45/95] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:27 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:27.890959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ce425899-0012-49c9-9fd6-575d2b1bfd5f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.225757 Aug 24 11:07:27.891555 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 51/96] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:27 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:27.904281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:27.904958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:27.907181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:27.907798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:27.911877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.912222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.912886 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.913753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.914178 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.914763 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.915007 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.915169 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.915451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:27.916716 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:27.917166 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:27.917595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:28.124810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:28.129521 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:28.133726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:28.135232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-49179655-d254-4914-9660-c71e026ce526 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.234716 Aug 24 11:07:28.136214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 46/97] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:27 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:28.140256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:28.141742 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:28.142846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8f6f8af4-a449-4573-8be2-d265682fa86a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.239417 Aug 24 11:07:28.143411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 52/98] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:27 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:28.912490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:28.914969 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:28.915594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:28.917249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:28.926338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:28.926820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:28.927316 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:28.928079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:28.929306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:28.929306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:28.934669 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:28.935180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:28.935617 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:28.936289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:28.936735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:28.937148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:29.128675 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:29.132983 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:29.141018 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3511cb10-60c1-4eb3-ac52-c2cf61b04348 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.236349 Aug 24 11:07:29.141918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 47/99] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:28 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:29.144250 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-53f97b20-8821-4989-b1e6-be0a2b75c90b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.236132 Aug 24 11:07:29.144898 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 53/100] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:28 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:29.156526 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:29.157416 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:29.163683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:29.164143 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:29.164886 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:29.165396 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:29.165560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:29.166006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:29.166097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:29.166418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:29.172091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:29.172566 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:29.172995 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:29.173680 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:29.174145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:29.174543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:29.360683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:29.363985 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:29.368650 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-955bd4da-db51-46af-9cb4-14c35018dee2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.216192 Aug 24 11:07:29.369216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 48/101] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:29 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:29.372734 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:29.374228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:29.375343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-87ae8e4c-afef-45ad-ac57-064dd20017cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.214337 Aug 24 11:07:29.375927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 54/102] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:29 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:30.164206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:30.165177 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:30.167925 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:30.168991 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:30.175308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.175977 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.176160 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.176437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.176805 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.177377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.177527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.177945 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.178462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.178571 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.179431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.179856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.198213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:30.382762 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:30.386453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:30.390720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-27042f8b-5123-4c5f-b700-a2a0db01c47a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.229331 Aug 24 11:07:30.392197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 55/103] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:30 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:30.394793 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-dd74f9c4-85ae-4878-9aaf-ac25c61e5b25 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.236320 Aug 24 11:07:30.395559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 49/104] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:30 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:30.400032 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:30.400594 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:30.400705 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:30.401632 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:30.406723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.407081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.407538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.408172 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.408328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.408647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.408797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.409063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.409198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.409743 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:30.410200 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:30.410614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:30.615122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:30.621542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:30.626133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:30.628374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:30.630014 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3cd8658a-493e-4dbb-bcd9-d133ff327521 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.233572 Aug 24 11:07:30.630809 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 50/105] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:30 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:30.632547 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-650b14e1-e6fa-4613-9b44-80e0f94f6f9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.239947 Aug 24 11:07:30.633236 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 56/106] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:30 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:31.412439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:31.413543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:31.415864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:31.416470 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:31.420364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.420850 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.421279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.421968 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.422418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.422764 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.422864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.423270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.423699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.424425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.424856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.425457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.620957 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:31.629735 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1d0b4b99-d29a-49fd-8c88-ae295fc239db tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.221370 Aug 24 11:07:31.630312 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 51/107] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:31 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:31.636750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:31.647912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3223a987-37d2-4bdc-a519-9ae0901490fa tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.236227 Aug 24 11:07:31.648518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 57/108] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:31 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:31.654689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:31.655313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:31.658587 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:31.659310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:31.663114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.663522 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.663989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.664982 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.665431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.665839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.665970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.666472 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.666895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.667635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:31.668078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:31.668467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:31.871501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:31.874769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:31.879790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-40a842bd-20be-45cc-b344-7e3398281c51 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.229986 Aug 24 11:07:31.880397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 52/109] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:31 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:31.883333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:31.884886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:31.886051 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bc0922cb-963a-458b-b557-382998517ffd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.231500 Aug 24 11:07:31.886848 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 58/110] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:31 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:32.658578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:32.659297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:32.666528 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.667002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.667454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.668133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.668553 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.668992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.669128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:32.669540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:32.675855 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.677155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.677155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.677374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.677844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.678304 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.879992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:32.883642 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:32.888578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9ffc5a39-6924-467f-9c26-ad6a0bce3269 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.235750 Aug 24 11:07:32.889172 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 53/111] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:32 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:32.891890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f1c5e9cf-ce6a-45d2-9b04-12f000e358e5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.226709 Aug 24 11:07:32.892504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 59/112] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:32 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:32.903074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:32.903828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:32.909551 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:32.910139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:32.910541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.911078 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.911534 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.912221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.913050 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.913520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.916730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.917209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.917625 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:32.918294 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:32.918733 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:32.919165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:33.111268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:33.115286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:33.120141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-485c3f37-aaa6-4914-8854-bbb8b29d98ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.223138 Aug 24 11:07:33.120753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 54/113] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:32 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:33.124942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:33.126630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:33.127817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5db23e7f-a820-4efd-ab74-b8a6106841ad tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.221989 Aug 24 11:07:33.128304 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 60/114] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:32 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:33.911267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:33.911928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:33.913177 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:33.913824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:33.920469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:33.921280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:33.921542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:33.922029 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:33.922421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:33.922551 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:33.923349 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:33.923799 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:33.924150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:33.924265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:33.924873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:33.925521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.145532 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.149073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.158591 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-230918d0-990e-441d-b142-eff6afc53b88 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.250022 Aug 24 11:07:34.159720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1af5914b-aaeb-4bc7-b784-060508142d75 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.254235 Aug 24 11:07:34.160954 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 55/115] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:33 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:34.167295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 61/116] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:33 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:34.173626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:34.174224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:34.185059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.185518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:34.187219 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:34.187408 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.189632 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.190414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.190977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.191763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.196321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.197235 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.197840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.198920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.199323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.200024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.398863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.403595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.406790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0b01f577-9ec0-4bc6-be9e-a2a2ffcd04e5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.244591 Aug 24 11:07:34.407364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 56/117] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:34 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:34.412085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.414780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:34.416060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-70c54e96-f042-4766-b1b0-defab55354d5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.246975 Aug 24 11:07:34.423173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 62/118] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:34 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:34.470669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-f281151d-f4d2-4d31-8da3-fe8c3d091d7c req-eabb74a5-86fe-448c-beb6-375644cd505a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a833b4-640b-4266-a7d9-0163551401c8", "name": "network-vif-plugged", "status": "completed", "tag": "9924d3d2-5b59-4069-a6f1-573cc73adf70"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:34.481483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f281151d-f4d2-4d31-8da3-fe8c3d091d7c req-eabb74a5-86fe-448c-beb6-375644cd505a service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:34.481955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f281151d-f4d2-4d31-8da3-fe8c3d091d7c req-eabb74a5-86fe-448c-beb6-375644cd505a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:34.482385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f281151d-f4d2-4d31-8da3-fe8c3d091d7c req-eabb74a5-86fe-448c-beb6-375644cd505a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:34.494204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-f281151d-f4d2-4d31-8da3-fe8c3d091d7c req-eabb74a5-86fe-448c-beb6-375644cd505a service nova] Creating event network-vif-plugged:9924d3d2-5b59-4069-a6f1-573cc73adf70 for instance e2a833b4-640b-4266-a7d9-0163551401c8 on hv-cinder-85427 Aug 24 11:07:34.499278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-f281151d-f4d2-4d31-8da3-fe8c3d091d7c req-eabb74a5-86fe-448c-beb6-375644cd505a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090777 Aug 24 11:07:34.499862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 57/119] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:35.181266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:35.182013 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:35.189727 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.190207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.190628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.191526 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.192146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.192759 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.193289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:35.194112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:35.200868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.201584 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.202295 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.202939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.203565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.204228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.408053 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:35.419578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-adfac45e-6b88-4a52-886f-8b27d74ca5b6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.242594 Aug 24 11:07:35.420970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 63/120] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:35 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:35.421352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:35.428831 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:35.429510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:35.433800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9cf75e12-0f13-4311-a55b-fbb2afef1d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.244842 Aug 24 11:07:35.436557 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.436557 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.436924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.437623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.438074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.438489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.439769 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 58/121] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:35 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:35.453593 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:35.454790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:35.461909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.462584 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.463002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.463936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:35.464694 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:35.465191 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:35.676987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:35.680195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:35.689783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:35.691938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:35.692929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-879aa437-ba27-475c-850a-ead3d5552626 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.268184 Aug 24 11:07:35.693792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e795285a-e604-48c6-8779-3bf853c69625 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.252602 Aug 24 11:07:35.694711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 64/122] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:35 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:35.707913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 59/123] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:35 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:36.450123 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:36.450842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:36.460822 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:36.462000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:36.463857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:36.473238 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:36.473940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:36.475949 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:36.476726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:36.477226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:36.477666 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:36.478150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:36.478344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:36.479854 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:36.484462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:36.486379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.299368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.319653 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.332095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1bea1fc1-0dc3-4a84-924c-6a915a401089 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.875682 Aug 24 11:07:37.333810 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 65/124] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:36 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:37.340393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:37.340578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b6c63a0e-2579-420b-8d8e-9f7805d998dd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.874216 Aug 24 11:07:37.341471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:37.344093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 60/125] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:36 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:37.351996 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.352825 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.354147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.355108 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.355908 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.356668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.362909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:37.363661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:37.382758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.383279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.388163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.389517 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:37.391342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:37.391799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:37.785567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.796915 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.800559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.803333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ace6c8c8-acc6-4b18-9a0c-27205cfbf14b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.458082 Aug 24 11:07:37.803909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 61/126] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:37 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:37.807222 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:37.815371 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a41235f2-482f-499e-a905-941f4299f997 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.479615 Aug 24 11:07:37.818425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 66/127] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:37 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:38.368601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:38.369408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:38.379582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.382785 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.383027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:38.383683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.387012 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:38.388040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.388522 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.388952 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.400228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.400909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.401565 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.402755 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.403474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.404089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.643865 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:38.652592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-422752c4-f5d3-4d37-aed7-c23b4c35b297 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.286485 Aug 24 11:07:38.653369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 67/128] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:38 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:38.704259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:38.717523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-edf7b43b-9b1c-42d8-b7e9-95cd261b70c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.350899 Aug 24 11:07:38.727083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 62/129] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:38 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:38.841328 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:38.842773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:38.843845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:38.847254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:38.854673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.858620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.859021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.859700 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.860286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.860853 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.861725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.862567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:38.863213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.863843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:38.864514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:38.865096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.105271 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:39.113850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d2c5d33e-9014-4930-897d-356af1ccf660 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.281577 Aug 24 11:07:39.117042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 68/130] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:38 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:39.150987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:39.160409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:39.163015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:39.164546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cdd63452-6928-4852-939b-4ef90c4d08d4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.329228 Aug 24 11:07:39.196204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 63/131] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:38 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:39.673639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:39.674231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:39.680474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:39.680954 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:39.681593 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.682468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:39.682961 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:39.683321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.702530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:39.744351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:39.745002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:39.751986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:39.752822 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:39.753408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.754598 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:39.755228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:39.755827 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:39.917434 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:39.929448 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1968083f-7d9f-43b7-a565-13dfa31c66fc tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.258985 Aug 24 11:07:39.932953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 69/132] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:39 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:39.980005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:39.988110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c9e417a5-244e-44a4-889d-54c248f80acc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.251960 Aug 24 11:07:40.001548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 64/133] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:39 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:40.100709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-36d3101e-1c6e-454f-83e6-d703b70441e7 req-4619367b-fe56-42ec-9c4e-1c449ca4ab0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02fe8ce-b37d-4d03-a1b1-3b434850514d", "name": "network-vif-plugged", "status": "completed", "tag": "3eb1fd1c-0294-4966-b482-f9a4c66d814b"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:40.111640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-36d3101e-1c6e-454f-83e6-d703b70441e7 req-4619367b-fe56-42ec-9c4e-1c449ca4ab0e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:40.112453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-36d3101e-1c6e-454f-83e6-d703b70441e7 req-4619367b-fe56-42ec-9c4e-1c449ca4ab0e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:40.113012 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-36d3101e-1c6e-454f-83e6-d703b70441e7 req-4619367b-fe56-42ec-9c4e-1c449ca4ab0e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:40.129032 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-36d3101e-1c6e-454f-83e6-d703b70441e7 req-4619367b-fe56-42ec-9c4e-1c449ca4ab0e service nova] Creating event network-vif-plugged:3eb1fd1c-0294-4966-b482-f9a4c66d814b for instance e02fe8ce-b37d-4d03-a1b1-3b434850514d on hv-cinder-85427 Aug 24 11:07:40.136799 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-36d3101e-1c6e-454f-83e6-d703b70441e7 req-4619367b-fe56-42ec-9c4e-1c449ca4ab0e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039761 Aug 24 11:07:40.137309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:40.138197 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:40.140386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 70/134] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:40.148676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:40.149479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:40.150330 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:40.152560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:40.153124 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:40.155604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:40.193457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:40.194191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:40.204695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:40.205195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:40.205625 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:40.207492 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:40.208052 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:40.211143 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:40.417170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:40.420388 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:40.425339 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3f6f2a35-f1f2-41eb-91b4-2cf31f9406a1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.292146 Aug 24 11:07:40.426349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 65/135] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:40 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:40.429745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:40.431452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:40.433138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eb6eacb3-48bf-4be3-842b-3b0bd648e581 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.244531 Aug 24 11:07:40.433780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 71/136] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:40 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:07:40.950051 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:40.950659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:40.956942 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:40.957446 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:40.957914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:40.959001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:40.959513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:40.960009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.009887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:41.010763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:41.018072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.018563 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.018997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.019722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.020233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.020662 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.141364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:41.144839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:41.150255 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-59ba5179-6561-4c5c-bc7b-25be09e63990 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.204087 Aug 24 11:07:41.150821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 66/137] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:40 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:41.179502 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:41.187816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-114e6a81-e2e7-4fd9-a150-2a1569279273 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.182997 Aug 24 11:07:41.188351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 72/138] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:41 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:41.446424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:41.447071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:41.453522 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.454002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.454423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.455103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.455587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.455999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.458098 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:41.458760 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:41.464942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.465418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.465839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.466514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:41.466952 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:41.467386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:41.651006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:41.654303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:41.659343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-32e92eab-7e3c-4559-b740-01f67207ca2b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.217183 Aug 24 11:07:41.659908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 67/139] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:41 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:41.663332 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:41.665164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:41.666265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e3f9d5de-6cbe-4368-a0b1-3ed7b33436c5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.212640 Aug 24 11:07:41.666820 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 73/140] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:41 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:42.175222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:42.176190 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:42.186434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.187292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.188000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.189115 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.189857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.190544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.208289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:42.208892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:42.215815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.216299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.216732 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.217458 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.217879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.218298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.389012 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:42.397101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-036cdb53-a400-47b1-873c-241e5cd560b9 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.228320 Aug 24 11:07:42.397641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 68/141] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:42 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:42.403819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:42.412578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-295cea14-dd0e-4af3-a15b-40072d0efacb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.207700 Aug 24 11:07:42.413165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 74/142] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:42 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:42.681153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:42.681755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:42.687967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.688451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.688878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.689209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:42.689587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.689932 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:42.690076 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.690456 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.696821 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.697307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.697735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.698422 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:42.698869 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:42.699322 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:42.890670 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:42.895892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:42.902197 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b246f275-0a40-4ce5-9d6b-cb059c36709a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.225499 Aug 24 11:07:42.902783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 69/143] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:42 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:42.905759 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:42.908327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:42.910423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-272c36b5-ba6a-4942-a39d-b8f775b4cf2d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.224823 Aug 24 11:07:42.911197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 75/144] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:42 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:43.419843 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:43.420448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:43.428024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.428943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.429503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.430210 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.430665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.431077 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.434758 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:43.435454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:43.441781 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.442308 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.442692 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.443467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.443902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.444580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.630323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:43.633760 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:43.638790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b4654890-fd46-45f6-8988-5dce43cb78e6 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.223594 Aug 24 11:07:43.639587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 70/145] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:43 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:43.642030 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5b25d715-1509-48ed-9de3-2b3e963cbaeb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.211574 Aug 24 11:07:43.642599 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 76/146] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:43 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:43.929566 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:43.930113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:43.933276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:43.933902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:43.936282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.936780 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.937190 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.937874 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.938322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.938732 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.939955 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.940424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.940872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:43.941541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:43.941986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:43.942396 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:44.131509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:44.134535 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:44.140493 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6716d18b-0319-455b-99d5-a4fefd95a016 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.215732 Aug 24 11:07:44.141154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 71/147] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:43 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:44.143314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:44.145247 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:44.146893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1e022898-4fb5-4e6b-8248-56bf8895bf5d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.217180 Aug 24 11:07:44.147685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 77/148] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:43 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:44.659771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:44.660282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:44.662335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:44.662937 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:44.667269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:44.667658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:44.668211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:44.668999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:44.669325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:44.669649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:44.669807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:44.670235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:44.670335 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:44.670921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:44.671430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:44.671826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:44.877915 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:44.882354 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:44.886878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c9c71077-8120-4b58-a3e2-24f252c92f02 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.230950 Aug 24 11:07:44.887501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 72/149] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:44 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:44.891481 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7926c4e0-7a3e-461e-976a-0bb2b3bccd27 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.233068 Aug 24 11:07:44.892282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 78/150] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:44 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:45.161341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:45.162064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:45.169005 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:45.169433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.169597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:45.170001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.170402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.171200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.171600 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.172013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.176145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.176624 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.177015 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.177885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.178331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.178751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.375397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:45.378450 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:45.384001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-57ae8a6b-270a-473f-9450-a8d82c323f43 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.226784 Aug 24 11:07:45.384572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 73/151] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:45 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:45.397263 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:45.397263 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:45.397263 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2147ffd1-d9a7-4656-8d2e-4c2493cd2ab4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.225416 Aug 24 11:07:45.397543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 79/152] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:45 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:45.908956 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:45.910137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:45.912751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:45.913244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=99 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:45.914490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:45.919402 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.919913 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.920467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.920597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.921030 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.921318 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.921421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.921761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.922101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:45.922200 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:45.922531 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:45.922957 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:46.134230 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:46.139027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:46.145403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7f7a020a-d6cb-4950-b3d0-c5c7181cdc82 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.236393 Aug 24 11:07:46.146204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 74/153] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:45 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:46.157356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e68b667e-a658-400a-843f-5f3eeab53e24 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1314 microversion: 2.1 time: 0.252080 Aug 24 11:07:46.159220 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 80/154] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:45 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:46.406095 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:46.406689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:46.412967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:46.413321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:46.413457 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:46.414153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:46.414303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:46.414851 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:46.415333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:46.415886 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:46.420339 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:46.420815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:46.421245 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:46.421928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:46.422374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:46.422789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:46.622278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:46.627703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:46.629922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-92a8fb67-ab82-48e6-8f84-ef6cabd6a1a4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.227717 Aug 24 11:07:46.630509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 75/155] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:46 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:46.638584 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:46.640398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:46.641703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-21dcd5d4-78ed-4d58-a253-d1223fb16c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.232439 Aug 24 11:07:46.642394 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 81/156] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:46 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:47.168460 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:47.168460 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:47.177483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.178095 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.178673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.179647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.180178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.180700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.181011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:47.182093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:47.195876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.196508 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.196946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.198357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.198817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.199325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.651547 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:47.655769 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:47.665849 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d8d04d17-e4ee-4dd4-a4b7-06c457f29699 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.502597 Aug 24 11:07:47.666440 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 76/157] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:47 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:47.666715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4947d325-356d-4645-b271-29b77b55a6e2 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1502 microversion: 2.1 time: 0.491184 Aug 24 11:07:47.667535 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 82/158] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:47 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1502 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:47.670843 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:47.671463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:47.680661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.681548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.682238 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.682441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:47.683390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.684062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.684590 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:47.684794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.697771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.698312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.698691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.699424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:47.699852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:47.703912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:47.983255 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:47.988287 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:48.001905 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:48.010915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:48.013230 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-be835267-d26d-4bf7-9eef-970085630f4f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.345773 Aug 24 11:07:48.014164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13d03671-b7bc-4ec5-a75e-0b81f7aabdb5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.345515 Aug 24 11:07:48.015076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 83/159] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:47 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:48.031269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 77/160] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:47 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:48.196915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-1e16b203-0fc1-4fa0-af5a-20b6ce3059c1 req-04b02000-23af-4f54-ba7c-8719bc2d8bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4f034f-a8a6-47f5-a6a6-f420a528333f", "name": "network-vif-plugged", "status": "completed", "tag": "1bc718d7-7c18-4093-b2ae-95110a425a49"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:48.215432 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1e16b203-0fc1-4fa0-af5a-20b6ce3059c1 req-04b02000-23af-4f54-ba7c-8719bc2d8bfe service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:48.217145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1e16b203-0fc1-4fa0-af5a-20b6ce3059c1 req-04b02000-23af-4f54-ba7c-8719bc2d8bfe service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:48.217733 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1e16b203-0fc1-4fa0-af5a-20b6ce3059c1 req-04b02000-23af-4f54-ba7c-8719bc2d8bfe service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:48.236370 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-1e16b203-0fc1-4fa0-af5a-20b6ce3059c1 req-04b02000-23af-4f54-ba7c-8719bc2d8bfe service nova] Creating event network-vif-plugged:1bc718d7-7c18-4093-b2ae-95110a425a49 for instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f on hv-cinder-85427 Aug 24 11:07:48.242759 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-1e16b203-0fc1-4fa0-af5a-20b6ce3059c1 req-04b02000-23af-4f54-ba7c-8719bc2d8bfe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050584 Aug 24 11:07:48.243490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 84/161] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:48.687129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:48.687754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:48.694441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:48.695002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:48.695545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:48.696293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:48.696890 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:48.697435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:48.858401 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:48.866611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4b40dd4b-9bcc-4390-8f31-4bd05b3296aa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.183316 Aug 24 11:07:48.867453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 78/162] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:48 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:49.035985 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:49.036949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:49.042898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:49.043370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:49.049034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.049902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.050529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.051326 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.051930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.052497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.054698 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.055788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.056445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.057839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.058919 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.059854 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.380837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:49.388899 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:49.399915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2c77931e-d4c7-44a8-bda1-1b726ab1da22 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.365364 Aug 24 11:07:49.415622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 85/163] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:49 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:49.415843 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:49.415843 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:49.421916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "214cc188-8b45-4cae-85d6-42acb7eb1d1f"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:49.423835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-108d3e5a-b15d-4877-822e-cbc6ec1b0f42 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.377946 Aug 24 11:07:49.427943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 79/164] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:49 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:49.430701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:49.450551 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.452539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.452977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.453682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.455468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.455903 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.888665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:49.889521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:49.900186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.902273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.903941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:49.904963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:49.906856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:49.907730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.144346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:50.160242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e5e30fb7-962a-4179-993c-2159a16c9e5a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.276071 Aug 24 11:07:50.161443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 80/165] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:49 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:50.426345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:50.427040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:50.433536 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.434200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.434786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.435512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.436113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.436571 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.644203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:50.653255 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4eb80ab0-95fe-4a89-b688-888a48260480 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.230917 Aug 24 11:07:50.654480 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 81/166] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:50 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:50.659665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:50.660842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:50.673487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.674294 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.675824 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.676743 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:50.678079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:50.678850 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:50.846223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:50.857543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:50.860219 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:50.862112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-746657c7-9487-4949-8178-385bb7e67236 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.206232 Aug 24 11:07:50.863016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 82/167] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:50 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:51.182608 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:51.184045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:51.193741 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:51.194406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:51.195007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:51.196359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:51.197528 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:51.198131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:51.228719 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:51.525936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:51.535872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-344cd0f5-edf7-4a99-b9cd-813c88421fde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.358479 Aug 24 11:07:51.536450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 83/168] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:51 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:51.678880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:51.679543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:51.681777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=97 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:51.687583 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:51.688331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:51.688905 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:51.689782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:51.690317 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:51.690686 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:51.872035 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:51.885824 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b71d916c-82fa-4773-934b-0913d1bd8a31 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.211792 Aug 24 11:07:51.899494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 84/169] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:51 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:51.907471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:51.908178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:51.916450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:51.917237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:51.917674 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:51.923946 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:51.924430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:51.924864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:52.158468 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:52.169275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:52.171490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:52.172885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4968e1f2-18c2-445b-bc5b-cde7e93d21b3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.272152 Aug 24 11:07:52.173647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 85/170] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:51 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:52.533488 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-6b8c25af-878b-4a88-8061-788443601295 req-ba78d3e2-f90e-44d4-83e0-477dfc60d12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7140e32-0590-472a-a151-bd551fb262fe", "name": "network-vif-plugged", "status": "completed", "tag": "da8a304b-8b4f-4b24-acb2-ae0932287926"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:52.555343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-6b8c25af-878b-4a88-8061-788443601295 req-ba78d3e2-f90e-44d4-83e0-477dfc60d12b service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:52.557152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-6b8c25af-878b-4a88-8061-788443601295 req-ba78d3e2-f90e-44d4-83e0-477dfc60d12b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:52.558885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-6b8c25af-878b-4a88-8061-788443601295 req-ba78d3e2-f90e-44d4-83e0-477dfc60d12b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:52.583630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-6b8c25af-878b-4a88-8061-788443601295 req-ba78d3e2-f90e-44d4-83e0-477dfc60d12b service nova] Creating event network-vif-plugged:da8a304b-8b4f-4b24-acb2-ae0932287926 for instance c7140e32-0590-472a-a151-bd551fb262fe on hv-cinder-85427 Aug 24 11:07:52.598565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-6b8c25af-878b-4a88-8061-788443601295 req-ba78d3e2-f90e-44d4-83e0-477dfc60d12b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068937 Aug 24 11:07:52.600628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 86/171] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:07:52.617835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:52.619966 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:52.633643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:52.634307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:52.638990 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:52.639951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:52.640572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:52.641145 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:52.938775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:52.949800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5749bbe2-5fe6-466b-9e6c-fe541b34c5df tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.346487 Aug 24 11:07:52.968656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 87/172] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:52 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:52.981892 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:52.982911 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:52.992000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:52.992975 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:52.993748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:52.994762 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:52.995695 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:52.996627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:53.183934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:53.197530 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7bf9ff72-37b6-450f-b8e4-bbd7755b35a5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.226616 Aug 24 11:07:53.198211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 88/173] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:52 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:53.202910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:53.203602 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:53.209889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:53.210606 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:53.211353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:53.212262 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:53.212794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:53.213275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:53.369869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:53.378630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:53.380198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:53.381816 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9f4dd849-5573-4f54-90b1-067e8aebce84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.182606 Aug 24 11:07:53.382366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 89/174] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:53 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:53.975122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:53.976789 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:53.983797 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:53.984448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:53.985138 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:53.985914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:53.986673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:53.987242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:54.131685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:54.144436 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c2dacee5-ec0a-4d28-9067-9de33d420486 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.173880 Aug 24 11:07:54.146176 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 90/175] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:53 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:54.218251 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:54.218859 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:54.227324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:54.227801 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:54.228391 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:54.229461 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:54.230002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:54.230428 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:54.374845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:54.383286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e9b981b6-64ae-40e3-8611-49a15c8f7a52 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.169323 Aug 24 11:07:54.384183 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 91/176] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:54 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:54.408074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:54.408657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:54.415866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:54.416381 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:54.416810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:54.417511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:54.417957 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:54.418426 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:54.553871 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:54.562201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:54.563808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:54.565020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6492f269-0b8f-4e3a-9b4e-919477590a04 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.161462 Aug 24 11:07:54.565647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 92/177] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:54 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:07:55.167476 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:55.168168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:55.175274 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:55.175757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:55.176183 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:55.176872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:55.177323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:55.177808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:55.318399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:55.327093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-200e2bfa-02ba-4ee4-b8a6-8b06e3a618c3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.165122 Aug 24 11:07:55.327543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 93/178] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:55 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:55.404192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:55.404823 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:55.410951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:55.411521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:55.411998 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:55.412672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:55.413108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:55.413514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:55.546820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:55.562285 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fb674d90-e6de-46db-8d57-e9ba326e000e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.161961 Aug 24 11:07:55.562859 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 94/179] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:55 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:55.588298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:55.589047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:55.595655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:55.596163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:55.596591 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:55.597274 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:55.597721 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:55.598179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:55.751558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:55.764830 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:55.766314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:55.767479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-76514ba8-de30-4a56-b63c-0f4927810621 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.183728 Aug 24 11:07:55.768034 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 95/180] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:55 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:07:56.348449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:56.349026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:56.355659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:56.356168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:56.356596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:56.357311 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:56.357758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:56.358174 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:56.499423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:56.513893 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-40103fa1-7a2b-4497-bc17-fc508f839adc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.169242 Aug 24 11:07:56.531016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 96/181] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:56 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:56.584397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:56.585455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:56.597199 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:56.597790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:56.598187 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:56.599013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:56.599782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:56.600379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:56.753673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:56.762584 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3d13ff0f-4daa-4135-81e6-1611248dbd53 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.182500 Aug 24 11:07:56.775723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 97/182] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:56 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:07:56.797367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:56.797840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:56.805895 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:56.806770 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:56.807380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:56.808260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:56.809559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:56.809985 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:56.954910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:56.963722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:56.965188 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:56.966275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c4bd8c76-768d-44e3-9020-33a610666c7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.175566 Aug 24 11:07:56.966826 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 98/183] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:56 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:07:57.181374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:57.213631 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-43b52729-59e1-47e5-bf30-23cda3e8a23a tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "POST /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.807119 Aug 24 11:07:57.214510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 86/184] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:07:49 2022] POST /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8/os-volume_attachments => generated 194 bytes in 7810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:07:57.553652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:57.554322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:57.561267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:57.562169 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:57.562303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:57.562924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:57.563405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:57.563816 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:57.700791 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:57.709113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7858b924-2930-4f48-9b02-e121fb136ed5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.159828 Aug 24 11:07:57.709667 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 99/185] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:57 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:57.784958 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:57.785694 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:57.792670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:57.793137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:57.793565 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:57.794250 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:57.794691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:57.795126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:57.945055 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:57.952846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a072e5b7-7f2a-425c-a62b-d8daf566c46c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.172576 Aug 24 11:07:57.953330 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 87/186] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:57 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:57.989060 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:57.989743 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:57.996225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:57.996689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:57.997104 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:57.997850 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:57.998290 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:57.998702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:58.144390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:58.151231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:58.154015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:58.155581 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:58.156737 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2c6f67af-3f31-43f6-91f0-ee85b0b236f9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.171590 Aug 24 11:07:58.157283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 100/187] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:57 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:58.476089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-026d1579-e52b-4757-9778-f51f742de061 req-ae0bed95-1c1a-4d40-8151-426fd89cfa55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7358f8-2cd1-41ac-a439-4630ad8630bc", "name": "network-vif-plugged", "status": "completed", "tag": "3265d28a-dfe5-435c-80d8-88ded1a20382"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:07:58.486987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-026d1579-e52b-4757-9778-f51f742de061 req-ae0bed95-1c1a-4d40-8151-426fd89cfa55 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:58.487735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-026d1579-e52b-4757-9778-f51f742de061 req-ae0bed95-1c1a-4d40-8151-426fd89cfa55 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:58.487891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-026d1579-e52b-4757-9778-f51f742de061 req-ae0bed95-1c1a-4d40-8151-426fd89cfa55 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:58.500516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-026d1579-e52b-4757-9778-f51f742de061 req-ae0bed95-1c1a-4d40-8151-426fd89cfa55 service nova] Creating event network-vif-plugged:3265d28a-dfe5-435c-80d8-88ded1a20382 for instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc on hv-cinder-85427 Aug 24 11:07:58.505573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-026d1579-e52b-4757-9778-f51f742de061 req-ae0bed95-1c1a-4d40-8151-426fd89cfa55 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Aug 24 11:07:58.506071 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 88/188] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:07:58.732439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:58.732992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:58.739640 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:58.740257 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:58.740653 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:58.741347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:58.742053 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:58.742384 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:58.878902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:58.891237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-349d7d17-cf0b-4140-89af-c1d93b331d97 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1322 microversion: 2.1 time: 0.163548 Aug 24 11:07:58.891860 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 101/189] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:58 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:58.975791 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:58.976483 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:58.983269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:58.983900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:58.984427 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:58.985171 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:58.986298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:58.986795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:59.143299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:59.153923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b9428d4a-d767-41a2-b658-859ca9177185 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.183331 Aug 24 11:07:59.167658 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 89/190] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:58 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:07:59.180305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:59.180902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:59.186938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:59.187638 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:59.188066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:59.188755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:59.189199 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:59.189610 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:59.334515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:59.350399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:59.352331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:07:59.353990 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d44d902f-d006-424d-8917-52ecc7400074 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.177982 Aug 24 11:07:59.354794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 102/191] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:07:59 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:07:59.913922 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:07:59.915389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:07:59.924144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:59.924922 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:59.925703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:07:59.926790 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:07:59.927658 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:07:59.928289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.089430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:00.097218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-459f9bd5-874d-44b1-b704-99169168f2c8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1516 microversion: 2.1 time: 0.188717 Aug 24 11:08:00.097790 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 90/192] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:07:59 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:00.118780 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:00.121118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:00.127733 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.128265 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.128640 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.129321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.129762 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.130171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.177139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:00.177752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:00.185194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.185727 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.186500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.187279 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.187775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.188327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.198055 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lazy-loading 'flavor' on Instance uuid 2c4f034f-a8a6-47f5-a6a6-f420a528333f {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:08:00.324883 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e104570c-1961-4da7-b721-eaa4b2c3c00e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f/action" status: 200 len: 32 microversion: 2.1 time: 0.209617 Aug 24 11:08:00.329920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 103/193] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:08:00 2022] POST /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:08:00.334531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:00.338396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:00.339487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:00.345602 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-574e319b-20e4-442b-a97b-7ea8b9d0aebc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.172155 Aug 24 11:08:00.345926 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.346402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.346817 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.347024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 91/194] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:00 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:00.351011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.351513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.351938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.378695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:00.379479 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:00.385972 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.386734 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.387360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.388214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:00.388822 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:00.389335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:00.583382 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:00.598488 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3102233a-0d48-4d22-833d-0593f10f3e56 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.264501 Aug 24 11:08:00.611305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 104/195] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:00 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:00.614973 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:00.625976 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:00.627960 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:00.629165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-976828c1-758b-4bbf-b5f0-bbc706ea4b29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.255190 Aug 24 11:08:00.639837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 92/196] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:00 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:08:01.370818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:01.371453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:01.377857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:01.378349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:01.378880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:01.379616 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:01.380071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:01.380492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:01.522112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:01.534035 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fb8cbb45-7951-417b-9a49-3aae2590ff4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.168981 Aug 24 11:08:01.535013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 105/197] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:01 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:01.621234 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:01.621819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:01.628638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:01.629128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:01.629561 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:01.630237 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:01.630701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:01.631221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:01.653205 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:01.654000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:01.660135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:01.660739 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:01.661396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:01.662318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:01.662958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:01.663797 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:01.841324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:01.848612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:01.848917 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e4b0dd7b-9875-44e9-b4a0-6a6a7134a3eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.231779 Aug 24 11:08:01.849479 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 93/198] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:01 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:01.857774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:01.859327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:01.860387 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-26ad6f2e-c4fe-44fc-a8cf-15a77eca2b06 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.211631 Aug 24 11:08:01.861135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 106/199] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:01 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:08:02.558464 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:02.559094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:02.565368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:02.565841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:02.566262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:02.566964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:02.567417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:02.567825 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:02.701176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:02.709106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6f9b1d60-a67a-4737-b6e3-2ead863f9c8d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.155919 Aug 24 11:08:02.709661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 94/200] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:02 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:02.872893 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:02.873488 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:02.880138 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:02.880626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:02.881053 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:02.881725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:02.882054 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:02.882213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:02.882836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:02.882982 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:02.889518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:02.889971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:02.890396 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:02.891321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:02.891768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:02.892184 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:03.078104 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:03.082298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:03.086121 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d09c29be-5304-4869-b3c7-55a08b9996e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.217615 Aug 24 11:08:03.086779 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 107/201] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:02 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:03.101594 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:03.103085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:03.104249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-816622eb-a76f-45a5-80be-52fba6c35a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.225995 Aug 24 11:08:03.104807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 95/202] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:02 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:08:03.730647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:03.731395 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:03.737917 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:03.738481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:03.738983 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:03.739756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:03.740280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:03.740876 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:03.879539 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:03.888009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-52f63e5e-472e-4a53-9664-071e6bc11c86 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.161935 Aug 24 11:08:03.888605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 108/203] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:03 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:04.108212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:04.108783 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:04.115864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:04.116343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:04.116774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:04.117453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:04.117902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:04.118321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:04.126829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:04.127521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:04.133929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:04.134403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:04.134837 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:04.135566 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:04.136017 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:04.136414 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:04.323793 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:04.331755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:04.332107 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-610bd4d6-31b2-4038-a335-2021b0ff215e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.227795 Aug 24 11:08:04.332665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 96/204] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:04 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:04.340613 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:04.342096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:04.343247 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fa131cde-a3b6-4e7d-a0ba-ad74d2e02673 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.220394 Aug 24 11:08:04.343813 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 109/205] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:04 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:08:04.917286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:04.918259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:04.927824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:04.928507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:04.929096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:04.930146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:04.930808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:04.931507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:05.066845 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:05.078893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d04cad87-d5ed-4349-b7bf-4f4f141d27a0 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.168406 Aug 24 11:08:05.079717 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 97/206] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:04 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:08:05.355905 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:05.356422 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:05.362716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:05.363234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:05.363663 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:05.364338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:05.364782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:05.364926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:05.365364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:05.365580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:05.372466 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:05.372946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:05.373367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:05.374053 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:05.374494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:05.374901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:05.565168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:05.568292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:05.573236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-65fd0db3-1c28-4008-87e9-f56dbf4d0222 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.223078 Aug 24 11:08:05.573896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 110/207] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:05 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:05.577614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:05.579153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:05.580242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-498af72d-186b-4673-9c9a-04e38a2d81db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.219349 Aug 24 11:08:05.580828 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 98/208] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:05 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:08:06.104164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:06.104653 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:06.110997 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:06.111511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:06.112122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:06.112795 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:06.113235 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:06.113644 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:06.253680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:06.261831 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7da3bb97-008f-42af-ad4f-118c2b420192 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1364 microversion: 2.1 time: 0.163984 Aug 24 11:08:06.262396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 111/209] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:06 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:06.596755 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:06.597490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:06.601840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:06.602439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:06.605259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:06.605812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:06.606244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:06.607037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:06.607797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:06.608218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:06.608847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:06.609329 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:06.609759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:06.610446 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:06.610896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:06.611332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:06.799817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:06.808066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9fb9b4fc-3dbf-43ff-aeec-885c1e99df50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.215282 Aug 24 11:08:06.808798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 99/210] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:06 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:06.811204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:06.819446 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:06.820936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:06.823320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-098dd3dc-3079-4dbe-bb33-44e8be3a9430 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.224756 Aug 24 11:08:06.824114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 112/211] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:06 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:08:07.285399 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:07.286293 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:07.293976 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.294622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.295251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:07.295942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.296388 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.296978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:07.483628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:07.493985 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac01adec-a9f3-43ca-8bd3-2653c0175d49 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1549 microversion: 2.1 time: 0.213623 Aug 24 11:08:07.495080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 100/212] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:07 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1549 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:07.516316 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:07.516881 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:07.523072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.523803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.524503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:07.525410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.526128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.526555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:07.623864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8d969865-9be5-4507-9f30-b8747aeb3d6e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111363 Aug 24 11:08:07.626136 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 113/213] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:08:07 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:07.828606 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:07.829951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:07.837254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.838232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.838913 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:07.839887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.840522 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.841123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:07.848186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:07.848896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:07.857922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.858741 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.859560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:07.860511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:07.861421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:07.862159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:08.189458 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:08.201026 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5d1c1ace-057c-432d-9e7e-f5c4db58c1e8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.376604 Aug 24 11:08:08.202157 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 101/214] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:07 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:08.206769 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:08.230390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:08.235516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:08.237117 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-04cf6525-9cf0-4293-9095-1206aecb8979 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1407 microversion: 2.20 time: 0.393024 Aug 24 11:08:08.237758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 114/215] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:07 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:08:09.226067 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:09.226803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:09.240217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:09.242531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:09.243088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:09.245824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:09.246411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:09.247970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:09.281572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:09.282986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:09.293571 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:09.294541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:09.306483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:09.307988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:09.308763 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:09.309429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:09.710037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:09.726605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-27dd8aae-495c-44e1-9865-7b36c5dd86e3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.506074 Aug 24 11:08:09.740167 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 102/216] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:09 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:09.745650 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-f92f82f4-8fa3-4a08-a89f-bfd4b59a17f4 req-a88a0ae9-fdf3-41f2-b60d-71b141e6900f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7140e32-0590-472a-a151-bd551fb262fe", "tag": "da8a304b-8b4f-4b24-acb2-ae0932287926"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:09.757405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f92f82f4-8fa3-4a08-a89f-bfd4b59a17f4 req-a88a0ae9-fdf3-41f2-b60d-71b141e6900f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:09.758228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f92f82f4-8fa3-4a08-a89f-bfd4b59a17f4 req-a88a0ae9-fdf3-41f2-b60d-71b141e6900f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:09.758798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-f92f82f4-8fa3-4a08-a89f-bfd4b59a17f4 req-a88a0ae9-fdf3-41f2-b60d-71b141e6900f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:09.773488 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-f92f82f4-8fa3-4a08-a89f-bfd4b59a17f4 req-a88a0ae9-fdf3-41f2-b60d-71b141e6900f service nova] Creating event network-changed:da8a304b-8b4f-4b24-acb2-ae0932287926 for instance c7140e32-0590-472a-a151-bd551fb262fe on hv-cinder-85427 Aug 24 11:08:09.780089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-f92f82f4-8fa3-4a08-a89f-bfd4b59a17f4 req-a88a0ae9-fdf3-41f2-b60d-71b141e6900f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038107 Aug 24 11:08:09.780938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 103/217] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:09.801499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:09.805679 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:09.813442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:09.814976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:09.816179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-eb2d483a-515d-4ea9-9b2e-6a5ac28d1bc5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1599 microversion: 2.20 time: 0.560921 Aug 24 11:08:09.817060 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 115/218] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:08:09 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1599 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:08:09.846297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:09.846297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:09.852083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:09.852633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:09.852987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:09.853798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:09.854277 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:09.854890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:09.861638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:10.023757 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-11d254b7-7e2b-4188-b8b9-502acd69b90d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.188107 Aug 24 11:08:10.024792 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 104/219] 10.222.0.79 () {60 vars in 1316 bytes} [Wed Aug 24 11:08:09 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:08:10.749981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:10.750668 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:10.768726 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:10.771887 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:10.773173 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:10.775131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:10.777221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:10.777970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:11.272487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:11.293875 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-73850a9a-7035-4b7b-b2c9-1cb7d3bea6a4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.550343 Aug 24 11:08:11.307986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 116/220] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:10 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:12.115379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-e4e81a9a-444f-4ba2-8e82-49591145140b req-4c4d26fa-7147-49c0-a5f4-8ab1b834e356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7358f8-2cd1-41ac-a439-4630ad8630bc", "tag": "3265d28a-dfe5-435c-80d8-88ded1a20382"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:12.141005 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4e81a9a-444f-4ba2-8e82-49591145140b req-4c4d26fa-7147-49c0-a5f4-8ab1b834e356 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:12.142662 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4e81a9a-444f-4ba2-8e82-49591145140b req-4c4d26fa-7147-49c0-a5f4-8ab1b834e356 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:12.150000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4e81a9a-444f-4ba2-8e82-49591145140b req-4c4d26fa-7147-49c0-a5f4-8ab1b834e356 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:12.194210 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-e4e81a9a-444f-4ba2-8e82-49591145140b req-4c4d26fa-7147-49c0-a5f4-8ab1b834e356 service nova] Creating event network-changed:3265d28a-dfe5-435c-80d8-88ded1a20382 for instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc on hv-cinder-85427 Aug 24 11:08:12.206397 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-e4e81a9a-444f-4ba2-8e82-49591145140b req-4c4d26fa-7147-49c0-a5f4-8ab1b834e356 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095580 Aug 24 11:08:12.213380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 105/221] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:12.318878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:12.320193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:12.328912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:12.331166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:12.331709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:12.336038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:12.336938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:12.338374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:12.714601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:12.723910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1d5b3946-d215-44bf-95ab-39a45863bcc4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.409149 Aug 24 11:08:12.726485 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 117/222] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:12 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:13.781710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:13.782808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:13.797855 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:13.798905 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:13.799689 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:13.800892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:13.801863 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:13.802812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:14.025537 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:14.033430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-392ffb6d-234e-44eb-b160-35a87b29f81d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.265442 Aug 24 11:08:14.037767 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 106/223] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:13 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:15.061683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:15.063021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:15.069452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:15.069937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:15.070370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:15.071091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:15.071922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:15.072937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:15.267716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:15.276255 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-10da2469-0f52-4cfa-9230-00964176e1d0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.218727 Aug 24 11:08:15.291506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 118/224] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:15 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:16.300777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:16.300777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:16.303577 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=54 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:16.309575 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:16.310070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:16.310502 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:16.311247 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:16.311707 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:16.312144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:16.479920 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:16.488135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a295d85e-aba4-46c4-bbda-653d3766d4d3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.193858 Aug 24 11:08:16.489046 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 107/225] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:16 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:16.930105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:16.930658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:16.937140 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:16.937819 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:16.938247 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:16.938965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:16.939632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:16.940043 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:16.965149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:08:17.075691 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2b89cdf9-0559-4ba0-b1ae-e319327a230f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 204 len: 0 microversion: 2.1 time: 0.149579 Aug 24 11:08:17.079601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 119/226] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:08:16 2022] DELETE /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:08:17.089062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:17.089768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:17.101673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:17.101673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:17.101673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:17.101946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:17.102380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:17.102797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:17.254770 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:17.265202 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3351cb18-2df7-4a48-a6fb-a8b8526b356f tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1554 microversion: 2.1 time: 0.180216 Aug 24 11:08:17.265808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 108/227] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:17 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:17.511330 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:17.512014 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:17.518073 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:17.518500 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:17.518922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:17.519720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:17.520159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:17.520563 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:18.017206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:18.031315 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-56872377-6edc-438c-938d-e062b13c583c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.524374 Aug 24 11:08:18.041357 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 120/228] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:17 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:18.287109 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:18.287893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:18.296286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:18.296884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:18.297412 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:18.298196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:18.298771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:18.299319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:18.546802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:18.558337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3cfc3173-8d6f-4c30-9a4d-f80901386e0c tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1554 microversion: 2.1 time: 0.275515 Aug 24 11:08:18.563198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 109/229] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:18 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1554 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:19.053471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:19.054951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:19.062396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:19.062909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:19.063386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:19.064072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:19.064724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:19.065021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:19.236809 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:19.248264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cc41e453-243e-4b8d-a738-2c29cf4f6052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.199357 Aug 24 11:08:19.255129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 121/230] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:19 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:19.583944 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:19.584543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:19.593211 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:19.593695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:19.594292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:19.594990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:19.595709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:19.596264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:19.792671 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:19.806036 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7e0df7c1-87d5-410c-996e-f480a0957c98 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1554 microversion: 2.1 time: 0.225747 Aug 24 11:08:19.806780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 110/231] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:19 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:20.271445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:20.272237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:20.302668 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:20.304604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:20.306216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:20.312618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:20.313342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:20.316199 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:20.415543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-8e4bb6c2-811b-44b0-835a-8f8961d07a22 req-fd8a0780-298f-40f1-aa19-5368a96210eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a833b4-640b-4266-a7d9-0163551401c8", "name": "network-vif-deleted", "tag": "9924d3d2-5b59-4069-a6f1-573cc73adf70"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:08:20.439555 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8e4bb6c2-811b-44b0-835a-8f8961d07a22 req-fd8a0780-298f-40f1-aa19-5368a96210eb service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:20.442614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8e4bb6c2-811b-44b0-835a-8f8961d07a22 req-fd8a0780-298f-40f1-aa19-5368a96210eb service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:20.443567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-8e4bb6c2-811b-44b0-835a-8f8961d07a22 req-fd8a0780-298f-40f1-aa19-5368a96210eb service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:20.491303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-8e4bb6c2-811b-44b0-835a-8f8961d07a22 req-fd8a0780-298f-40f1-aa19-5368a96210eb service nova] Creating event network-vif-deleted:9924d3d2-5b59-4069-a6f1-573cc73adf70 for instance e2a833b4-640b-4266-a7d9-0163551401c8 on hv-cinder-85427 Aug 24 11:08:20.498530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-8e4bb6c2-811b-44b0-835a-8f8961d07a22 req-fd8a0780-298f-40f1-aa19-5368a96210eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087509 Aug 24 11:08:20.504477 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 111/232] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:08:20.541501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:20.550336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9a8bc7f6-72e5-4e9e-bca3-fc6a86c2858a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.283909 Aug 24 11:08:20.550913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 122/233] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:20 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:20.830412 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:20.831465 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:20.838427 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:20.838915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:20.839369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:20.840066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:20.840516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:20.840937 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:20.905094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:20.914285 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0865b6f1-9b3e-49e8-ad3e-b2f628fb8fcd tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1345 microversion: 2.1 time: 0.088199 Aug 24 11:08:20.914844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 112/234] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:20 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:21.572884 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:21.573693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:21.580790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:21.581280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:21.581706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:21.582393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:21.582829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:21.583294 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:21.725842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:21.735160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1e0b8774-2450-43fe-8579-de9de6534e04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.166079 Aug 24 11:08:21.735790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 123/235] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:21 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:21.936463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:21.940360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:21.944406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:21.944999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:21.945764 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:21.946803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:21.947451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:21.947969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:21.985843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:21.986425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:21.986991 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:21.987625 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lazy-loading 'fault' on Instance uuid e2a833b4-640b-4266-a7d9-0163551401c8 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:08:22.031571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65475998205f4120bcdfc10fd0aada7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f9ef57fb3e4440b0f404cb757c5579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:22.039226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3d5f1570-1645-41a1-b57b-229eee42eefb tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 200 len: 1304 microversion: 2.1 time: 0.107407 Aug 24 11:08:22.039784 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 113/236] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:21 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:22.756828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:22.757399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:22.759431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:22.766270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:22.767004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:22.767767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:22.768934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:22.769631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:22.770276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:22.918788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:22.927353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ea178787-36f5-47fa-8ca1-fc0444232536 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.174095 Aug 24 11:08:22.927880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 124/237] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:22 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:23.059853 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:23.060473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:23.067386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:23.067858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:23.068289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:23.068977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:23.069431 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:23.069856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:23.084573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] HTTP exception thrown: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Request method failure captured: Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 HTTP/1.1 Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZJfXgK7XFp0flsY41nSi9KoFw8BR6YrWdqXlj1aD3RrZRKb-W358PvdwZqRHuMs82K-cLm2lwiStu4mtKxhMJe1yiG4RVXtYpq6s65lRDIGVlLVvHMf_n20PBXVc3by9AV_udRo6OBQMW0mZRuIFh-SLNbxZcKJHMVgY18vM6VeIQ Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:08:23.089425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_57f9ef57fb3e4440b0f404cb757c5579", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 65475998205f4120bcdfc10fd0aada7a Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.090876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'e2a833b4-640b-4266-a7d9-0163551401c8'} Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:08:23.091750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.093146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.094452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Returning 404 to user: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:08:23.094452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7a63c060-c756-4a20-9f2a-6d7134622b72 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 404 len: 111 microversion: 2.1 time: 0.034922 Aug 24 11:08:23.094452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 114/238] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:23 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:08:23.208409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:23.210749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:23.216582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:23.217176 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:23.217600 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:23.218494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:23.218944 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:23.219393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:23.236533 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] HTTP exception thrown: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Request method failure captured: Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8/os-volume_attachments HTTP/1.1 Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZJfXgK7XFp0flsY41nSi9KoFw8BR6YrWdqXlj1aD3RrZRKb-W358PvdwZqRHuMs82K-cLm2lwiStu4mtKxhMJe1yiG4RVXtYpq6s65lRDIGVlLVvHMf_n20PBXVc3by9AV_udRo6OBQMW0mZRuIFh-SLNbxZcKJHMVgY18vM6VeIQ Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:08:23.240730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_57f9ef57fb3e4440b0f404cb757c5579", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 65475998205f4120bcdfc10fd0aada7a Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.242024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'server_id': 'e2a833b4-640b-4266-a7d9-0163551401c8'} Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:08:23.242692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:23.244131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:23.245430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Returning 404 to user: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:08:23.245430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0e723f60-f5aa-4fdb-866b-cd0d02ae48a8 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037864 Aug 24 11:08:23.245430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 125/239] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:08:23 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:08:23.948099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:23.948964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:23.956254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:23.956743 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:23.957178 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:23.957867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:23.958477 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:23.959060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.104597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:24.112604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eb7bc2fd-cf44-4416-9b2c-bdd01ce35c53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.168598 Aug 24 11:08:24.113379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 115/240] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:23 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:24.479539 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:24.480726 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:24.488620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:24.489124 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:24.489560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.490273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:24.490713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:24.491159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.505409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] HTTP exception thrown: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Request method failure captured: Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: DELETE /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 HTTP/1.1 Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZJfXgK7XFp0flsY41nSi9KoFw8BR6YrWdqXlj1aD3RrZRKb-W358PvdwZqRHuMs82K-cLm2lwiStu4mtKxhMJe1yiG4RVXtYpq6s65lRDIGVlLVvHMf_n20PBXVc3by9AV_udRo6OBQMW0mZRuIFh-SLNbxZcKJHMVgY18vM6VeIQ Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:08:24.507989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_57f9ef57fb3e4440b0f404cb757c5579", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 65475998205f4120bcdfc10fd0aada7a Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.509435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'e2a833b4-640b-4266-a7d9-0163551401c8'} Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:08:24.510135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.511277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.513574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Returning 404 to user: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:08:24.513574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2377badf-35e9-4af5-b401-0d8ee478f3a5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 404 len: 111 microversion: 2.1 time: 0.035073 Aug 24 11:08:24.513574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 126/241] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:08:24 2022] DELETE /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:08:24.517550 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:24.518155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] [instance: e2a833b4-640b-4266-a7d9-0163551401c8] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:24.523929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:24.524410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:24.524843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.525514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:24.525961 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:24.526376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:24.540744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] HTTP exception thrown: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Request method failure captured: Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 HTTP/1.1 Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZJfXgK7XFp0flsY41nSi9KoFw8BR6YrWdqXlj1aD3RrZRKb-W358PvdwZqRHuMs82K-cLm2lwiStu4mtKxhMJe1yiG4RVXtYpq6s65lRDIGVlLVvHMf_n20PBXVc3by9AV_udRo6OBQMW0mZRuIFh-SLNbxZcKJHMVgY18vM6VeIQ Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:08:24.542269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_57f9ef57fb3e4440b0f404cb757c5579", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/57f9ef57fb3e4440b0f404cb757c5579"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 57f9ef57fb3e4440b0f404cb757c5579 Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-DeleteServersTestJSON-634784442 Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 65475998205f4120bcdfc10fd0aada7a Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-DeleteServersTestJSON-634784442-project Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.543709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'e2a833b4-640b-4266-a7d9-0163551401c8'} Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:08:24.548207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. Aug 24 11:08:24.549554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:08:24.550823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] Returning 404 to user: Instance e2a833b4-640b-4266-a7d9-0163551401c8 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:08:24.550823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-77d1662f-598d-48be-8993-311a9861dcc5 tempest-DeleteServersTestJSON-634784442 tempest-DeleteServersTestJSON-634784442-project] 10.222.0.79 "GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8" status: 404 len: 111 microversion: 2.1 time: 0.030107 Aug 24 11:08:24.550823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 116/242] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:24 2022] GET /compute/v2.1/servers/e2a833b4-640b-4266-a7d9-0163551401c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:08:25.134417 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:25.135013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:25.143113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:25.143677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:25.144105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:25.144832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:25.145514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:25.145921 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:25.564560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:25.578439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ad566ae2-ca44-4795-a4a5-e6e4fba3f8e9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.448017 Aug 24 11:08:25.579245 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 127/243] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:25 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:26.599962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:26.601485 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:26.611403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:26.613360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:26.615757 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:26.616527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:26.617015 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:26.618051 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:26.805111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:26.813372 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e272f737-21c3-498c-87d4-0b75b5ccac05 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.217348 Aug 24 11:08:26.832664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 117/244] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:26 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:08:27.836787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:27.837395 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:27.844093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:27.844573 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:27.845446 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:27.846142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:27.846631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:27.846997 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:28.111118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:28.120165 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-571f4ddf-fadc-4c40-8245-ea479b880b84 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.287190 Aug 24 11:08:28.122338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 128/245] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:27 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:29.142417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:29.143115 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:29.151272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:29.152452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:29.153142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:29.153973 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:29.154588 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:29.155091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:29.318533 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:29.327597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-04932ce7-a254-4bd7-ab32-7b2bbdd8d72f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.189202 Aug 24 11:08:29.328268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 118/246] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:29 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:30.348361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:30.348974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:30.355375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:30.355866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:30.356306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:30.357003 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:30.357450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:30.358766 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:30.505459 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:30.513182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f6dbaee1-310e-4cbe-a7e7-17376fa78323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.168739 Aug 24 11:08:30.513816 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 129/247] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:30 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:31.541665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:31.542323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:31.550166 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:31.550673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:31.551142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:31.551839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:31.552295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:31.552721 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:31.705430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:31.713894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-20d53578-ddd7-4fe0-b40a-95b4828bddfe tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.176553 Aug 24 11:08:31.714454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 119/248] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:31 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:32.736988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:32.737661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:32.746085 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:32.746633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:32.747198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:32.747927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:32.748625 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:32.749056 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:32.894180 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:32.902594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3c54aba4-e415-4b77-a73a-949180295d53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.169678 Aug 24 11:08:32.903160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 130/249] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:32 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:33.928454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:33.929320 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:33.939720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:33.940520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:33.941067 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:33.941964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:33.942529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:33.943085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:34.089092 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:34.100301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f65c2910-497b-4890-a5eb-585e1bf3a834 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.177789 Aug 24 11:08:34.101070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 120/250] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:33 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:35.124977 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:35.125547 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:35.132153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:35.132657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:35.133078 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:35.133763 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:35.134204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:35.134615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:35.274595 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:35.283760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5bdd512e-aeec-4e46-968c-7ad76f9f962b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.162735 Aug 24 11:08:35.284542 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 131/251] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:35 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:36.310033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:36.310763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:36.317641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:36.318121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:36.318559 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:36.319292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:36.319847 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:36.320257 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:36.463549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:36.471695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6485b14a-ee3e-454f-9e33-d34d2557a139 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.165721 Aug 24 11:08:36.472293 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 121/252] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:36 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:37.492865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:37.493529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:37.499981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:37.500447 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:37.500865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:37.501572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:37.502024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:37.502470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:37.506630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:37.654992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:37.663780 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8ec78bf1-d1f4-47fc-ace4-b8a07750cef5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.174736 Aug 24 11:08:37.664347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 132/253] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:37 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:38.685505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:38.686092 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:38.694777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:38.695386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:38.695861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:38.696871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:38.697436 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:38.698138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:38.834555 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:38.842744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-18aaa063-5f0b-4c58-a253-4938b41b1837 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.161078 Aug 24 11:08:38.843336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 122/254] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:38 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:39.864524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:39.865319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:39.872878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:39.873352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:39.873775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:39.874457 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:39.874896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:39.875313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:40.012100 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:40.019923 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b955b172-b63d-476b-809a-edf9e955dda1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.159921 Aug 24 11:08:40.020486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 133/255] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:39 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:41.040746 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:41.041455 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:41.048185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:41.048715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:41.049147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:41.049836 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:41.050284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:41.050694 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:41.053407 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:41.193951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:41.201912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-02825a2c-edec-4b14-995f-97dab24d8de0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.165456 Aug 24 11:08:41.202480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 123/256] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:41 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:42.227260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:42.228123 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:42.235294 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:42.235783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:42.236187 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:42.236862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:42.237302 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:42.237713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:42.386322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:42.396810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d4ede9ac-1554-4c13-a220-f83014d6f299 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.176025 Aug 24 11:08:42.397636 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 134/257] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:42 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:43.430284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:43.431810 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:43.443882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:43.444684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:43.445398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:43.446576 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:43.447380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:43.448318 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:43.581190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:43.588935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aa642cf8-1c3e-4cd1-aac7-3de65694d760 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.165535 Aug 24 11:08:43.589657 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 124/258] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:43 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:44.610110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:44.610696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:44.616991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:44.617462 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:44.617882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:44.618562 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:44.618998 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:44.619442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:44.756492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:44.768614 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7b1e4e3c-a7bd-4cd5-ad5b-e425c16d6514 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.162288 Aug 24 11:08:44.769372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 135/259] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:44 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:45.799961 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:45.800919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:45.810334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:45.811177 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:45.811772 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:45.812600 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:45.813180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:45.813685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:45.980436 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:45.992875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4ea2d47d-0180-4a3d-9244-424eba48bfc9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.201670 Aug 24 11:08:45.993421 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 125/260] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:45 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:08:47.013613 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:47.014284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:47.020495 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:47.020973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:47.021392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:47.022069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:47.022516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:47.022981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:47.156066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:47.164194 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-dfcfb76d-f1e0-44cf-bfde-ce536853343b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.154371 Aug 24 11:08:47.164761 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 136/261] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:47 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:48.187867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:48.188459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:48.190803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=40 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:48.196359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:48.196862 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:48.197277 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:48.197967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:48.198419 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:48.198838 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:48.340771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:48.349081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6b2d8313-6271-4dde-bff4-61799cee7c86 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.167018 Aug 24 11:08:48.349712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 126/262] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:48 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:49.369801 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:49.370432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:49.377139 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:49.377547 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:49.377973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:49.378728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:49.379173 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:49.379590 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:49.516328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:49.524489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5e9abbe1-22fe-4e17-ab19-6d99102b60b0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.158551 Aug 24 11:08:49.525049 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 137/263] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:49 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:50.546042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:50.547133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:50.553051 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:50.553599 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:50.554120 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:50.554870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:50.555390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:50.555885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:50.712401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:50.721630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-25d2ac7c-3f4f-4a24-814d-fdba4cdfe7dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.179641 Aug 24 11:08:50.722614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 127/264] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:50 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:51.743789 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:51.744278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:51.752240 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:51.752809 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:51.753683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:51.755386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:51.756003 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:51.756486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:51.896226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:51.904410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-568fc47c-9e66-463e-8efc-314929fd228a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.164577 Aug 24 11:08:51.905064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 138/265] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:51 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:08:52.926985 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:52.927611 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:52.934406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.934889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.935342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:52.935996 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:52.936744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:52.937203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:53.111911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:53.120113 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-403597df-cf42-40fb-b416-9d2e03892052 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.197912 Aug 24 11:08:53.120658 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 128/266] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:52 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:54.141643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:54.142669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:54.145680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=30 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:08:54.153820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:54.154502 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:54.155172 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:54.156074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:54.156496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:54.156903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:54.291338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:54.301479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a4ccf496-2359-4868-bbf7-db8be2097c3b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.164393 Aug 24 11:08:54.302208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 139/267] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:54 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:55.328274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:55.328644 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:55.335570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:55.336096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:55.336490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:55.337177 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:55.337624 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:55.338037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:55.476102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:55.484241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-072eb2ec-ea54-4cd0-b1a8-d6268331ddde tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.161598 Aug 24 11:08:55.484771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 129/268] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:55 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:56.510082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:56.511109 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:56.521882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.522608 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.523373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.524522 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:56.525213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:56.525948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:56.656869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:56.664918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fa02d865-d1d7-4e04-95a7-b38c78deb4be tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.161639 Aug 24 11:08:56.665483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 140/269] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:56 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:57.690523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:57.691436 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:57.703193 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:57.703684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:57.704126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:57.704821 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:57.705261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:57.705680 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:57.855704 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:57.864987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0b028192-cb23-470f-8ad9-fe6555a6da8c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.181482 Aug 24 11:08:57.865231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 130/270] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:57 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:08:58.889258 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:08:58.890223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:08:58.899861 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:58.900589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:58.901245 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:58.902267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:08:58.902935 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:08:58.903611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:08:59.276846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:08:59.285971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e3f0dea5-fad3-407f-af78-0c20c8a7d231 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.402780 Aug 24 11:08:59.286558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 141/271] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:08:58 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:00.312475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:00.313220 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:00.320360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:00.320851 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:00.321279 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:00.321962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:00.322411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:00.322824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:00.463287 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:00.471133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ff9bce75-5934-4942-a255-301b3ba01807 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.165699 Aug 24 11:09:00.471726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 131/272] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:00 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:01.491989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:01.492545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:01.499202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:01.499844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:01.500118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:01.501106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:01.501286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:01.501700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:01.639372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:01.647526 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-62b35fe9-cd42-4af5-ba46-dc276144d68d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.159480 Aug 24 11:09:01.648108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 142/273] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:01 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:02.668834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:02.669359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:02.677235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:02.677722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:02.678139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:02.678833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:02.679337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:02.679762 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:02.818403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:02.830029 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bb1e7bed-dd38-4151-9630-836a3f0cbdc3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.164955 Aug 24 11:09:02.830901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 132/274] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:02 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:03.257456 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1642717481", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:03.312433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] validate_networks() for None {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:09:03.633818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:09:03.634266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:09:03.634725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:09:03.635179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:09:03.635583 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:09:03.646158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:03.646669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:03.647101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:03.647837 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:03.648282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:03.648695 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:03.666403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Getting quotas for project 114e23b76d8f40dfa50ccdc063adb58a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:09:03.670614 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Getting quotas for user 16526eb9b3f9446e98f24b996fa34a3c and project 114e23b76d8f40dfa50ccdc063adb58a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:09:03.682224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:09:03.684699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:09:03.732195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-81ff25f2-bec3-4805-b672-b69540f34d8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478551 Aug 24 11:09:03.733013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 143/275] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:09:03.744271 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a0c7258c-4ae6-4e81-93ca-b19f3d9df85e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:03.744876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a0c7258c-4ae6-4e81-93ca-b19f3d9df85e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:03.807468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a0c7258c-4ae6-4e81-93ca-b19f3d9df85e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:03.815545 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a0c7258c-4ae6-4e81-93ca-b19f3d9df85e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1215 microversion: 2.1 time: 0.075057 Aug 24 11:09:03.819552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 133/276] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:03 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:03.852803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:03.853493 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:03.860398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:03.861156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:03.861688 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:03.862651 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:03.863216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:03.863750 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:04.115356 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:04.123935 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1c9c0c29-9fd6-466e-9d56-989e77a9c6eb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.275833 Aug 24 11:09:04.124511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 144/277] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:03 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:04.840556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:04.841125 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:04.849919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:04.850430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:04.850861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:04.851581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:04.852037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:04.852456 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:04.914620 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:04.922745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-449744d1-9981-40c1-85a8-67c427c51da1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.087683 Aug 24 11:09:04.923357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 134/278] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:04 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:05.146544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:05.147407 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:05.154212 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:05.155358 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:05.155358 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:05.155885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:05.156343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:05.156751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:05.318019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:05.326691 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9661ebee-982d-4333-a1e5-af7f4560673e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.185067 Aug 24 11:09:05.327365 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 145/279] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:05 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:05.947030 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:05.947646 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:05.955200 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:05.955783 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:05.956208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:05.956882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:05.957321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:05.957730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:06.024983 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:06.033321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-204242ef-97ba-47cd-9f5c-71b5880771de tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.091586 Aug 24 11:09:06.033877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 135/280] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:05 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:06.352048 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:06.353066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:06.362970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:06.363808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:06.364509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:06.365633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:06.366367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:06.367040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:06.510364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:06.518364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1ad909db-d0ad-45b2-b3a1-a8bf946bcfa4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.172789 Aug 24 11:09:06.519013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 146/281] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:06 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:07.059208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:07.060190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:07.070636 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:07.071299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:07.071731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:07.072419 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:07.072864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:07.073266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:07.150143 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:07.158912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-257f848c-8fcc-497d-8b9e-1c484b01b4d9 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.106520 Aug 24 11:09:07.159513 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 136/282] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:07 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:07.542024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:07.542610 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:07.548752 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:07.549221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:07.549641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:07.550307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:07.550745 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:07.551192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:07.555428 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=85 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:07.693054 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:07.701256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-328f6afe-44f3-4c44-af8c-380bff46026c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.164494 Aug 24 11:09:07.701841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 147/283] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:07 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:08.184318 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:08.184872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:08.191668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:08.192158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:08.192589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:08.193278 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:08.193746 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:08.194168 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:08.260475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:08.268083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-788d76e7-9b5e-498b-a45d-ae71e971de64 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.089802 Aug 24 11:09:08.268611 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 137/284] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:08 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:08.729014 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:08.729609 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:08.735924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:08.736410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:08.736842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:08.737554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:08.737996 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:08.738407 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:08.896059 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:08.903832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f39896ae-7640-451f-b299-bbfcc531a5f0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.178856 Aug 24 11:09:08.904402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 148/285] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:08 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:09.290161 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:09.295305 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:09.297840 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:09.298327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:09.298756 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:09.299490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:09.299944 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:09.300363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:09.367415 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:09.375916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bb6f1871-bda0-421b-8dc2-dc2b455898a3 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.090901 Aug 24 11:09:09.376468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 138/286] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:09 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:09.929400 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:09.930494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:09.940927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:09.941695 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:09.942392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:09.943544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:09.944945 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:09.945351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:10.081374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:10.089810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c51ff433-af60-46bf-8da2-181ae84d778f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.167000 Aug 24 11:09:10.090366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 149/287] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:09 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:10.408965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:10.409564 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:10.420410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:10.420927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:10.421363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:10.422063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:10.423080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:10.424199 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:10.638548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:10.646507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3be8d38f-9c51-4738-bc8c-218616ecf72e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.244410 Aug 24 11:09:10.647069 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 139/288] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:10 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:11.111777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:11.112604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:11.119679 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:11.120315 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:11.120807 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:11.121472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:11.121909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:11.122318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:11.269729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:11.281260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c642f292-08fe-4857-b1b8-88b04cd6ec6c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.173269 Aug 24 11:09:11.281908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 150/289] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:11 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:11.672806 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:11.673838 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:11.683726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:11.684064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:11.684493 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:11.685174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:11.685615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:11.686027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:11.688662 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=96 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:11.748023 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:11.756047 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dfa39692-19c6-46cc-81d8-a334e04f0531 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.089788 Aug 24 11:09:11.756574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 140/290] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:11 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:12.308064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:12.308653 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:12.314858 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:12.315367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:12.315783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:12.316451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:12.316893 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:12.317293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:12.459279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:12.466377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b76aff09-5196-49a0-95ac-f1739b834c7c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.163539 Aug 24 11:09:12.466936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 151/291] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:12 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:12.780940 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:12.781627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:12.792183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:12.792731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:12.793196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:12.793950 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:12.794459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:12.794998 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:12.858735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:12.866392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2ab04ce4-5e28-49c2-a1e5-4d14b68a9a1c tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1211 microversion: 2.1 time: 0.092079 Aug 24 11:09:12.866945 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 141/292] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:12 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:13.488281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:13.488864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:13.495472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:13.495960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:13.496377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:13.497062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:13.497506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:13.497920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:13.635764 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:13.646878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-95cd1867-150d-49e3-9686-6f6071d27a68 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.162133 Aug 24 11:09:13.647673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 152/293] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:13 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:13.887746 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:13.888380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:13.891795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:13.895351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:13.895851 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:13.896284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:13.897064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:13.897398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:13.897812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:13.960950 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:13.969060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cc58b8f6-1d65-48ef-be33-a4a08a825f2f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1267 microversion: 2.1 time: 0.085231 Aug 24 11:09:13.969622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 142/294] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:13 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:14.668271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:14.668856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:14.670663 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:14.671327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:14.676892 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:14.677368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:14.677795 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:14.678470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:14.678937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:14.679373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:14.816555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:14.827246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c9b49e1b-2108-4115-8086-cd498293ac7f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.162557 Aug 24 11:09:14.827981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 153/295] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:14 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:14.998155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:14.998709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:15.005668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:15.006147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:15.006574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:15.007303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:15.007752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:15.008165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:15.079557 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:15.087454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5345b497-03f8-4d31-acfe-fd23f8f270c1 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1267 microversion: 2.1 time: 0.093166 Aug 24 11:09:15.087849 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 143/296] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:14 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:15.853317 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:15.853317 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:15.864135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:15.864627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:15.865046 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:15.865737 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:15.866177 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:15.866592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:16.022713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:16.033737 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1401ecee-63e2-4842-a508-eecfad71a21c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1522 microversion: 2.1 time: 0.185445 Aug 24 11:09:16.034308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 154/297] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:15 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:16.108208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:16.108883 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:16.115553 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:16.116033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:16.116456 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:16.117130 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:16.117571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:16.117982 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:16.181333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:16.189422 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6335b553-67c9-4359-89da-7db5343e8931 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1273 microversion: 2.1 time: 0.085224 Aug 24 11:09:16.189984 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 144/298] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:16 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:17.059271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:17.060015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:17.067320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:17.068321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:17.068862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:17.069650 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:17.070333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:17.070780 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:17.219756 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:17.220913 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:17.224063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:17.238470 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:17.239264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:17.239691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:17.240570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:17.241019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:17.241432 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:17.247877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-66a6f200-8ac8-4bc8-8e83-55034b9ee8c6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1502 microversion: 2.1 time: 0.193762 Aug 24 11:09:17.248592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 155/299] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:17 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:17.268091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:17.268690 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:17.274661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:17.275196 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:17.275813 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:17.276688 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:17.277134 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:17.277549 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:17.441540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:17.453265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7c02f665-9a08-49f4-9bc5-054961b45391 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.239018 Aug 24 11:09:17.453967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 145/300] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:17 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:17.466422 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:17.481858 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-db52a067-9153-43ba-963e-049ca5360440 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1516 microversion: 2.1 time: 0.217445 Aug 24 11:09:17.482437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 156/301] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:17 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:17.593019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-fa066fbe-4106-44d7-a033-70d78207ad44 req-2bed285f-8474-4e86-9073-77cd5abb3b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cee902b-8dc0-4186-b89d-f50c570e4bf7", "tag": "7ce998f8-1b50-4e1f-a758-5bba3fd7b957"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:17.609148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fa066fbe-4106-44d7-a033-70d78207ad44 req-2bed285f-8474-4e86-9073-77cd5abb3b59 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:17.610293 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fa066fbe-4106-44d7-a033-70d78207ad44 req-2bed285f-8474-4e86-9073-77cd5abb3b59 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:17.610728 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fa066fbe-4106-44d7-a033-70d78207ad44 req-2bed285f-8474-4e86-9073-77cd5abb3b59 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:17.624640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-fa066fbe-4106-44d7-a033-70d78207ad44 req-2bed285f-8474-4e86-9073-77cd5abb3b59 service nova] Creating event network-changed:7ce998f8-1b50-4e1f-a758-5bba3fd7b957 for instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 on hv-cinder-85427 Aug 24 11:09:17.630658 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-fa066fbe-4106-44d7-a033-70d78207ad44 req-2bed285f-8474-4e86-9073-77cd5abb3b59 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045142 Aug 24 11:09:17.631314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 146/302] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:09:18.476551 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:18.477850 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:18.484582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:18.485056 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:18.485676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:18.486529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:18.487149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:18.487717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:18.638922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:18.647472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4d27548c-2ec8-4865-91c3-5169ab16a623 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.175187 Aug 24 11:09:18.648163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 157/303] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:18 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:19.669489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:19.670198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:19.672653 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=44 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:19.678410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:19.678895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:19.679370 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:19.680052 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:19.680530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:19.680936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:19.822663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:19.834475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0dff715b-03b9-49ad-b3a0-8f7ae40a1ef0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.169199 Aug 24 11:09:19.835281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 147/304] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:19 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:19.975471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:19.977819 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:19.984722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:19.985200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:19.985620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:19.986305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:19.986748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:19.987285 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:20.011971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lazy-loading 'flavor' on Instance uuid e02fe8ce-b37d-4d03-a1b1-3b434850514d {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:09:20.098388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f341e582-736e-4e0e-bbda-05cb899fb8a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d/action" status: 200 len: 32 microversion: 2.1 time: 0.127017 Aug 24 11:09:20.099116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 158/305] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:09:19 2022] POST /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:09:20.108955 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:20.109564 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:20.116064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:20.116497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:20.116927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:20.117664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:20.118085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:20.118525 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:20.249704 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:20.261232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bb808e61-4b9e-4dc4-8d98-287b73dca9b9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.156250 Aug 24 11:09:20.261806 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 148/306] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:20 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:20.858427 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:20.859147 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:20.865882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:20.866374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:20.866800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:20.867531 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:20.867961 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:20.868371 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:21.015037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:21.023302 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a7f8bdc6-09aa-458f-ba53-454591fb93c0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.169133 Aug 24 11:09:21.023868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 159/307] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:20 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:21.282965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:21.283861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:21.293885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:21.294596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:21.295341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:21.296454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:21.297179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:21.297780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:21.433636 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:21.441494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b2393467-13b6-47a0-ae61-d572d310d843 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.162477 Aug 24 11:09:21.442021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 149/308] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:21 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:22.044332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:22.044892 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:22.053332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:22.054096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:22.054783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:22.055964 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:22.056696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:22.057374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:22.200201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:22.208236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8200d3f8-0acc-4a61-8870-96d04ad3a942 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.167860 Aug 24 11:09:22.208855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 160/309] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:22 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:22.462173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:22.462774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:22.469973 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:22.470455 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:22.470895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:22.471624 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:22.472076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:22.472491 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:22.606959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:22.615548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-08e2f034-59c4-42e0-8f2d-fa7f9171ea04 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.157289 Aug 24 11:09:22.616105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 150/310] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:22 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:23.231497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:23.232088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:23.238390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:23.238865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:23.239313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:23.239991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:23.240430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:23.240841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:23.514594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:23.517941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:23.527627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-20c4166b-431b-4562-aca2-3f517eaea171 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.300943 Aug 24 11:09:23.528621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 161/311] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:23 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:23.637529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:23.638077 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:23.645451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:23.645933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:23.646353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:23.647063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:23.647521 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:23.647933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:23.780213 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:23.788441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-15fb6660-59e7-40d5-9078-049b32ba0e79 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.155241 Aug 24 11:09:23.788976 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 151/312] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:23 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:24.555109 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:24.556035 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:24.558821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:24.570104 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:24.571000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:24.571749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:24.572848 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:24.573593 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:24.574243 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:24.709120 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:24.716884 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-94aacb9b-e930-46e2-b7e1-db3df008dd5d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.169080 Aug 24 11:09:24.717445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 162/313] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:24 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:24.811918 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:24.812906 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:24.821774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:24.822406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:24.822967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:24.823947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:24.824568 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:24.825427 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:24.961780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:24.970389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8f2c5c15-fca3-4c31-bae9-1dfc461ae6a3 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.164334 Aug 24 11:09:24.971079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 152/314] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:24 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:25.740204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:25.740965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:25.748592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:25.749120 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:25.749542 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:25.750202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:25.750637 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:25.751067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:25.880971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:25.889154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fcc90deb-524b-4b2f-a811-6316a9fda7e7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.154401 Aug 24 11:09:25.890096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 163/315] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:25 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:26.001913 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:26.002482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:26.009153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:26.009614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:26.010042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:26.010711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:26.011187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:26.011614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:26.150151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:26.162118 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-46ebdcd9-4e71-493f-ab31-21b2276b0b53 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.163501 Aug 24 11:09:26.163006 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 153/316] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:25 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:26.915036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:26.916061 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:26.925571 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:26.926055 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:26.926483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:26.927270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:26.927716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:26.928113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:27.062870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:27.074543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8ce5be4b-bace-4892-b7d4-f20037a4dac5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.166139 Aug 24 11:09:27.075353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 164/317] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:26 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:27.183454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:27.184004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:27.191080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:27.191573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:27.192002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:27.192679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:27.193150 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:27.193568 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:27.323974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:27.332448 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b816d832-240c-4b63-87e5-029cd4292c0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.152859 Aug 24 11:09:27.333028 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 154/318] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:27 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:28.106918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:28.107973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:28.118427 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:28.119348 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:28.120072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:28.121194 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:28.121960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:28.122572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:28.264951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:28.272941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-39c52398-5964-44a4-ac2b-4fb26dc2dee7 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.172773 Aug 24 11:09:28.273503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 165/319] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:28 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:28.357478 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:28.358341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:28.371514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:28.372190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:28.373293 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:28.374004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:28.374618 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:28.375257 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:28.518489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:28.526256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b82809b6-acd1-4ce9-a91d-f7e83be75323 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.175509 Aug 24 11:09:28.527005 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 155/320] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:28 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:29.294956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:29.295521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:29.302037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:29.302504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:29.302918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:29.303618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:29.304056 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:29.304457 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:29.456313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:29.464141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a03480e7-ca1d-4b89-83fa-f558083c9e1f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.173345 Aug 24 11:09:29.464702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 166/321] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:29 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:29.554222 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:29.554834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:29.563604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:29.564093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:29.564531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:29.565210 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:29.565667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:29.566088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:29.701230 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:29.712761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e9c36b15-106a-459f-b874-1654cb2641ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.165647 Aug 24 11:09:29.713399 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 156/322] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:29 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:30.488069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:30.488738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:30.494649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:30.495234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:30.495760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:30.496616 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:30.497126 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:30.497651 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:30.639155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:30.647290 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5f90a196-e75c-454b-81bc-9661a5dfdb10 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.165071 Aug 24 11:09:30.648038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 167/323] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:30 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:09:30.734953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:30.735591 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:30.742001 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:30.742554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:30.742949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:30.743674 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:30.744125 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:30.744534 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:30.759427 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:30.890633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:30.898259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-21e63115-397b-4427-97db-bd1b416792fc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.167266 Aug 24 11:09:30.898792 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 157/324] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:30 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:31.672034 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:31.672591 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:31.678734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:31.679168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:31.679578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:31.680235 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:31.680670 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:31.681071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:31.814408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:31.823119 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fccae4cb-c8a6-461f-b33c-f5df3bbb107d tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.154906 Aug 24 11:09:31.824161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 168/325] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:31 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:31.920749 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:31.921436 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:31.928406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:31.928936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:31.929299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:31.929974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:31.930418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:31.930857 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:32.080994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:32.092966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1fd5109f-bcda-42a5-8fcc-5c93bef30e19 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.175860 Aug 24 11:09:32.093849 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 158/326] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:31 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:32.848779 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:32.849562 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:32.858624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:32.859169 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:32.859546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:32.860229 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:32.860649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:32.861084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:32.998341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:33.006068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e2ac9003-ac8f-4fee-91e2-0fa7ef3f6101 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.164027 Aug 24 11:09:33.006627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 169/327] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:32 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:33.122542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:33.123687 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:33.134717 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:33.135546 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:33.136254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:33.137368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:33.138221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:33.138628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:33.278686 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:33.287318 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-99e0824e-ef1f-40ec-8967-1a9806505d8b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.170831 Aug 24 11:09:33.287882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 159/328] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:33 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:34.027103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:34.027720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:34.034289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:34.034775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:34.035227 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:34.036225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:34.036662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:34.037074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:34.177433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:34.186256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5b732791-950f-4d50-b3cb-ab108d52fedf tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.163013 Aug 24 11:09:34.186834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 170/329] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:34 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:34.312915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:34.313906 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:34.324677 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:34.325957 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:34.326400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:34.327089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:34.327576 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:34.327996 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:34.484569 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:34.492971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ab8d3724-831d-4604-adfc-99a5e20b6114 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.186916 Aug 24 11:09:34.493584 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 160/330] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:34 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:35.207772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:35.208369 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:35.214853 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:35.215306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:35.215731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:35.216487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:35.216939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:35.217353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:35.356152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:35.364538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b9720ebe-6ad7-4aa8-803a-c4b4704b9cec tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.160693 Aug 24 11:09:35.365103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 171/331] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:35 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:35.516701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:35.517380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:35.526470 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:35.527185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:35.527790 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:35.528742 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:35.529405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:35.529845 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:35.664185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:35.672419 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-20eb56eb-0928-4bd1-854e-751a229e3f33 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.161634 Aug 24 11:09:35.672986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 161/332] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:35 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:36.386519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:36.387846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:36.395241 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:36.395777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:36.396436 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:36.397165 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:36.397805 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:36.398232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:36.534513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:36.542552 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cdadecea-21bb-43d1-ba9f-d9d6b6d4e679 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.160186 Aug 24 11:09:36.543504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 172/333] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:36 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:36.693919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:36.695344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:36.702463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:36.703032 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:36.703565 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:36.704331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:36.704849 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:36.705323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:36.843430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:36.852889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c763c5a5-d537-4bad-abbf-0959e4b8d73c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.162779 Aug 24 11:09:36.864807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 162/334] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:36 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:37.567776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:37.568761 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:37.577943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:37.578351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:37.578773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:37.579498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:37.579954 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:37.580361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:37.720436 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:37.728425 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-02c9dabf-9f59-4e7b-bcbc-67571a8ff751 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.167136 Aug 24 11:09:37.729011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 173/335] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:37 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:37.875471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:37.876211 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:37.882754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:37.883267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:37.883731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:37.884416 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:37.884864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:37.885283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:38.062476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:38.081071 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0f728846-8af7-439a-899e-020f05322e37 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.210392 Aug 24 11:09:38.082766 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 163/336] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:37 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:38.749447 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:38.750057 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:38.756181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:38.756701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:38.757153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:38.757835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:38.758255 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:38.758666 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:38.896955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:38.905274 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6f4c4e59-afdf-447d-84e4-b619205a5c66 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.160049 Aug 24 11:09:38.905772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 174/337] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:38 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:39.111701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:39.112320 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:39.120182 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:39.120664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:39.121606 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:39.122568 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:39.122949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:39.123799 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:39.307254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:39.315975 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dec891ef-822f-47e5-9e2f-dfe86d7d4c49 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.209528 Aug 24 11:09:39.317138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 164/338] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:39 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:39.893863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-acb19299-44e9-4bd4-927c-8f33e9e3ff8c req-70b645b4-4706-4d57-9db7-ebd9a6f974a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cee902b-8dc0-4186-b89d-f50c570e4bf7", "name": "network-vif-plugged", "status": "completed", "tag": "7ce998f8-1b50-4e1f-a758-5bba3fd7b957"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:39.905599 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-acb19299-44e9-4bd4-927c-8f33e9e3ff8c req-70b645b4-4706-4d57-9db7-ebd9a6f974a4 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:39.906106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-acb19299-44e9-4bd4-927c-8f33e9e3ff8c req-70b645b4-4706-4d57-9db7-ebd9a6f974a4 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:39.906558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-acb19299-44e9-4bd4-927c-8f33e9e3ff8c req-70b645b4-4706-4d57-9db7-ebd9a6f974a4 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:39.920025 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-acb19299-44e9-4bd4-927c-8f33e9e3ff8c req-70b645b4-4706-4d57-9db7-ebd9a6f974a4 service nova] Creating event network-vif-plugged:7ce998f8-1b50-4e1f-a758-5bba3fd7b957 for instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 on hv-cinder-85427 Aug 24 11:09:39.925521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-acb19299-44e9-4bd4-927c-8f33e9e3ff8c req-70b645b4-4706-4d57-9db7-ebd9a6f974a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036063 Aug 24 11:09:39.926303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 175/339] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:09:39.930907 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:39.931768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:39.943271 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:39.944463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:39.946494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:39.947466 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:39.948065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:39.948965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:40.158122 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:40.169200 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8b469fbb-cd60-4774-9311-00d3d9330376 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.242640 Aug 24 11:09:40.170312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 165/340] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:39 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:40.338071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:40.338955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:40.350100 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:40.350458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:40.350928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:40.351643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:40.352592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:40.353011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:40.547875 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:40.559408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-245860d8-122c-481b-8999-b8b249282507 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.225536 Aug 24 11:09:40.560920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 176/341] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:40 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:41.190392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:41.191070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:41.197201 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:41.197678 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:41.198313 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:41.199009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:41.199474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:41.199892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:41.338339 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:41.347344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0f9ca482-6899-45f1-a9ba-e3ffab680bc5 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1315 microversion: 2.1 time: 0.160763 Aug 24 11:09:41.347916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 166/342] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:41 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:41.581023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:41.581626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:41.588458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:41.589073 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:41.589836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:41.590882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:41.591514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:41.592610 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:41.775408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:41.798117 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4dd8b7e3-ce2a-44ab-9750-be1265ebf2a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.220709 Aug 24 11:09:41.799390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 177/343] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:41 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:09:42.369737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:42.370988 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:42.378185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.378813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.379355 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:42.380199 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.380719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.381133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:42.678960 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:42.687721 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1269aa06-ab73-4986-ae60-b5c33664a7bc tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1464 microversion: 2.1 time: 0.323261 Aug 24 11:09:42.688301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 167/344] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:42 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:42.736222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:42.736775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:42.742864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.743393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.743814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:42.744492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.744929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.745334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:42.770612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:09:42.784934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:42.824906 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:42.827169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:42.842163 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.844761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.879244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:42.880100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.880595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.881002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-bbfd0a01-383e-4742-9cfb-b17cb38443d0 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 204 len: 0 microversion: 2.1 time: 0.148168 Aug 24 11:09:42.881137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:42.885605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 178/345] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:09:42 2022] DELETE /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:09:42.893702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:42.894779 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:42.901651 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.902545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.903321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:42.904533 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:42.905573 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:42.906275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:43.160967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:43.169144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-08707747-8cbe-4edd-bcc0-cda3527ec728 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.352263 Aug 24 11:09:43.174300 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 168/346] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:42 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:43.221316 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:43.233552 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9a03c6b4-6205-4bd2-999d-8fe8c1a1f48b tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1470 microversion: 2.1 time: 0.346207 Aug 24 11:09:43.240524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 179/347] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:42 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:44.199782 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:44.200392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:44.216375 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:44.217227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:44.217676 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:44.218424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:44.218877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:44.219324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:44.254073 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:44.254672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:44.261906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:44.266844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:44.267323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:44.268253 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:44.269135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:44.270160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:44.432523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:44.441415 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-47e1e1dd-180c-4f25-aa28-2640460fdee4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.245398 Aug 24 11:09:44.458208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 169/348] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:44 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:44.467130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:44.488153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6033b3c9-ad8f-45b4-97fd-b27aef7b26df tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1470 microversion: 2.1 time: 0.237796 Aug 24 11:09:44.489702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 180/349] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:44 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:45.469432 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:45.470703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:45.482291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:45.483549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:45.484145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:45.485033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:45.485656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:45.486233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:45.515350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:45.516900 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:45.530055 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:45.534008 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:45.536079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:45.537234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:45.539409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:45.541380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:45.817462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:45.829060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c572c6a7-4bf7-42bc-ac50-cf089df93641 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.370857 Aug 24 11:09:45.830935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 170/350] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:45 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:45.881465 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:45.891629 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a0bfdb56-3757-48e2-a05a-23a479dde88f tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1470 microversion: 2.1 time: 0.381444 Aug 24 11:09:45.892937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 181/351] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:45 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:46.853021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:46.854176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:46.862836 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:46.863628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:46.865272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:46.866011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:46.866471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:46.866894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:46.915555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:46.916164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:46.922374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:46.922852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:46.923305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:46.923988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:46.924429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:46.925034 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:47.200246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:47.210312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3e1a2c10-e44d-44ae-a057-a2b371595a58 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.361210 Aug 24 11:09:47.227005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:47.235855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-74a77bac-308e-4610-8c89-5a22086bdd60 tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1470 microversion: 2.1 time: 0.324834 Aug 24 11:09:47.236420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 171/352] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:46 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:47.239642 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 182/353] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:46 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:48.234367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:48.235119 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:48.242205 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.242812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.243559 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.244453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.245062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.246389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.261887 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:48.263187 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:48.283717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.284602 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.285646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.286773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.287506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.288098 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.713806 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16526eb9b3f9446e98f24b996fa34a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114e23b76d8f40dfa50ccdc063adb58a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:48.721833 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5ed02852-17d4-426d-a970-deb57188af8a tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 200 len: 1470 microversion: 2.1 time: 0.465400 Aug 24 11:09:48.722410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 183/354] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:48 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 1470 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:48.749580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:48.767527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-479b110c-2c7f-46cb-b7d0-2033e1c81e81 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.537219 Aug 24 11:09:48.769052 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 172/355] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:48 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:48.860551 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-2a4051d6-ca94-495e-b8fa-1aef664a9afc req-40b64adc-3374-4239-8b11-5b6791905330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cee902b-8dc0-4186-b89d-f50c570e4bf7", "name": "network-vif-deleted", "tag": "7ce998f8-1b50-4e1f-a758-5bba3fd7b957"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:48.882037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-2a4051d6-ca94-495e-b8fa-1aef664a9afc req-40b64adc-3374-4239-8b11-5b6791905330 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:48.889005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-2a4051d6-ca94-495e-b8fa-1aef664a9afc req-40b64adc-3374-4239-8b11-5b6791905330 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:48.891728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-2a4051d6-ca94-495e-b8fa-1aef664a9afc req-40b64adc-3374-4239-8b11-5b6791905330 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:48.932031 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-2a4051d6-ca94-495e-b8fa-1aef664a9afc req-40b64adc-3374-4239-8b11-5b6791905330 service nova] Creating event network-vif-deleted:7ce998f8-1b50-4e1f-a758-5bba3fd7b957 for instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 on hv-cinder-85427 Aug 24 11:09:48.944558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-2a4051d6-ca94-495e-b8fa-1aef664a9afc req-40b64adc-3374-4239-8b11-5b6791905330 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088041 Aug 24 11:09:48.945772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 184/356] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:09:49.751308 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:49.751930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] [instance: 2cee902b-8dc0-4186-b89d-f50c570e4bf7] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:49.760717 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=52 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:49.770169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:49.771097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:49.772451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:49.774100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:49.774481 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:49.774967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:49.795868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:49.796774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:49.811784 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:49.812512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:49.814327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:49.815326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:49.815782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:49.816207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:49.820816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] HTTP exception thrown: Instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 could not be found. Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Request method failure captured: Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 HTTP/1.1 Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgbF1daylOHhfeN1qs91YLrlyyIukoYxsyPP58ic8sX0gusEfAnRqrImjexu-4LhVHOAm0rp_sBgI_7rVgNxO41sR8rHnYsA5M8MIuzodfjlLS6TN1SlB09mkZ8qUH72vggqmwDZ0tQxXthuNpnlLvTxXf4hH7OjeEdv7dls1sX8XnQ Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 114e23b76d8f40dfa50ccdc063adb58a Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesNegativeTest-445678517 Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:09:49.822959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_114e23b76d8f40dfa50ccdc063adb58a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/114e23b76d8f40dfa50ccdc063adb58a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114e23b76d8f40dfa50ccdc063adb58a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114e23b76d8f40dfa50ccdc063adb58a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesNegativeTest-445678517 Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 114e23b76d8f40dfa50ccdc063adb58a Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesNegativeTest-445678517 Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesNegativeTest-445678517-project Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 16526eb9b3f9446e98f24b996fa34a3c Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesNegativeTest-445678517-project Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 could not be found. Aug 24 11:09:49.824346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '2cee902b-8dc0-4186-b89d-f50c570e4bf7'} Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 could not be found. Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:09:49.825144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 could not be found. Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 could not be found. Aug 24 11:09:49.826476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:09:49.828834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] Returning 404 to user: Instance 2cee902b-8dc0-4186-b89d-f50c570e4bf7 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:09:49.829282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-64eb54cd-a9d1-4488-95e2-8936f663bd2e tempest-VolumesNegativeTest-445678517 tempest-VolumesNegativeTest-445678517-project] 10.222.0.79 "GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7" status: 404 len: 111 microversion: 2.1 time: 0.084865 Aug 24 11:09:49.850520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 173/357] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:49 2022] GET /compute/v2.1/servers/2cee902b-8dc0-4186-b89d-f50c570e4bf7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:09:50.551874 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:50.565834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3936d3f2-cc8e-439f-a7e2-a19d0b5a57bb tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.777180 Aug 24 11:09:50.567747 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 185/358] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:49 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:51.592910 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:51.594570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:51.642690 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:51.645278 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:51.651926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:51.652914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:51.653893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:51.654376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:52.447203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:52.450818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:52.478738 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d0621b9e-35c8-405d-8ed2-b16aba26bea6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.878278 Aug 24 11:09:52.479655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 174/359] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:51 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:53.504443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:53.505046 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:53.520896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:53.521379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:53.521803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:53.522490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:53.522930 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:53.523366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:53.941354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:53.951087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-638f732d-b121-4c98-9153-8c5c410584c5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.450394 Aug 24 11:09:53.952202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 186/360] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:53 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:54.973898 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:54.975412 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:54.987236 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:54.999641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:54.999641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:54.999641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:54.999641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:55.000026 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:55.417165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:55.458929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b12c6d9b-9c46-4299-888e-95db172a343f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.488730 Aug 24 11:09:55.459292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 175/361] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:54 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:09:56.484090 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:56.484715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:56.493170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:09:56.494734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:56.498225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:56.498584 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:56.499344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:56.506369 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:56.506808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:56.829608 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:56.859728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f609cc13-9ed1-4e94-abab-958ea1cb9c67 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.379262 Aug 24 11:09:56.865949 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 187/362] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:56 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:09:57.774197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e696bac1-8fcc-4789-91c5-d72a2ae7dd39 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Action: 'create', calling method: .version_select at 0x7f82b6477550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1973796702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJSYG+7+YBczjRz8gXS+zScR9RlMTJB6C0+AmoJuzGo3QdJS/fG6tytATPkIkJRy13FjMMQnhq61h6ZJ/al1b7aCrtPVJnhAb1XykWQNzfyb78PU9gGA+r/EZgH7KGnnw=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:57.794282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-e696bac1-8fcc-4789-91c5-d72a2ae7dd39 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Getting quotas for project f1e957f00a814f2b89505181e43ba856. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:09:57.800485 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-e696bac1-8fcc-4789-91c5-d72a2ae7dd39 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Getting quotas for user 8df7721c8a694faebb58c00a0d870506 and project f1e957f00a814f2b89505181e43ba856. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:09:57.814028 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e696bac1-8fcc-4789-91c5-d72a2ae7dd39 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:09:57.893918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:57.896174 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:57.903995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:57.904542 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:57.905397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:57.906706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:57.907569 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:57.908140 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.255064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:58.265664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-667203f1-8585-4d7f-9c74-f63e94a70db1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1502 microversion: 2.1 time: 0.375690 Aug 24 11:09:58.266260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 188/363] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:57 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1502 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:09:58.299985 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5775e30e-a6e5-4140-af4e-8023530b9f45"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:58.303926 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:58.317103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.318617 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.319297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.321157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.322128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.324182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.458006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] HTTP exception thrown: Cannot 'attach_volume' instance e02fe8ce-b37d-4d03-a1b1-3b434850514d while it is in vm_state rescued Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Request method failure captured: Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: POST /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d/os-volume_attachments HTTP/1.1 Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 74 Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZNTWI46EyWOVthpnrkpQbS04WegfQ-JCzszT53sEwlXHpfW8PBTRCrT4o6AmA1pbqg-yl54Vcrv1zn938p0u8pmb_DzHMe6n-Og-swCi7u1baTQpfDPBYLvWWiCbrZMMCuXPfwEwrOKYrhsSgRP_13YhN_GvDbhsgWI1W6c2dc6K4 Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:09:58.463001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18b9988b1131422f9db644695c1df22d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18b9988b1131422f9db644695c1df22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: e808c04cd77d446ca2c05712868b7ce3 Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {"volumeAttachment": {"volumeId": "5775e30e-a6e5-4140-af4e-8023530b9f45"}} Aug 24 11:09:58.464777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Cannot 'attach_volume' instance e02fe8ce-b37d-4d03-a1b1-3b434850514d while it is in vm_state rescued Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'server_id': 'e02fe8ce-b37d-4d03-a1b1-3b434850514d', 'body': {'volumeAttachment': {'volumeId': '5775e30e-a6e5-4140-af4e-8023530b9f45'}}} Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e02fe8ce-b37d-4d03-a1b1-3b434850514d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:09:58.465787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e02fe8ce-b37d-4d03-a1b1-3b434850514d while it is in vm_state rescued Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:09:58.467385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:09:58.468619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:09:58.468619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:09:58.468619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e02fe8ce-b37d-4d03-a1b1-3b434850514d while it is in vm_state rescued Aug 24 11:09:58.468619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:09:58.472860 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Returning 409 to user: Cannot 'attach_volume' instance e02fe8ce-b37d-4d03-a1b1-3b434850514d while it is in vm_state rescued {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:09:58.477609 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7a3361c3-ce82-4a97-a27b-859a6bf47277 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.188945 Aug 24 11:09:58.481709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 189/364] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:09:58 2022] POST /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d/os-volume_attachments => generated 152 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:09:58.499359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:09:58.504911 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:58.522128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.522869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.523562 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.524453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.526901 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.527533 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.704632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-40b05eed-f0ac-4fb2-8b69-c6e17c7b2d03 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d/action" status: 202 len: 0 microversion: 2.1 time: 0.217793 Aug 24 11:09:58.705258 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 190/365] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:09:58 2022] POST /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:09:58.714729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:09:58.716038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:09:58.722631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.723128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.723711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.724626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:09:58.725217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:09:58.725629 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:09:58.822895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [None req-e696bac1-8fcc-4789-91c5-d72a2ae7dd39 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 42114. Aug 24 11:09:58.843850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e696bac1-8fcc-4789-91c5-d72a2ae7dd39 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.300967 Aug 24 11:09:58.850695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 176/366] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:09:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:09:59.092835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:09:59.110684 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-be28a7bb-d38d-4534-93ad-f6860feb80f1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1510 microversion: 2.1 time: 0.400058 Aug 24 11:09:59.122222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 191/367] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:09:58 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:00.135980 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:00.136574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:00.147311 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:00.147965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:00.148449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:00.149386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:00.149963 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:00.150330 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:00.399137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:00.411935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-412b083a-df0c-4559-9ae5-d16785a18077 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1510 microversion: 2.1 time: 0.280824 Aug 24 11:10:00.427459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 177/368] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:00 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:01.225244 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2013496039", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "networks": [{"uuid": "fd33c4da-38ba-45dd-961d-689f940e1722"}]}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:01.296697 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] validate_networks() for [('fd33c4da-38ba-45dd-961d-689f940e1722', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:10:01.435336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:01.436102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:01.445368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:01.446277 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:01.446980 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:01.447858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:01.448406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:01.448951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:01.704592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:01.712927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0e9a0131-4394-427e-a6e7-79f7f6fa7777 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1510 microversion: 2.1 time: 0.282919 Aug 24 11:10:01.714024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 178/369] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:01 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:01.987786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:10:01.988200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:10:02.002588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:10:02.002588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:10:02.002588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:10:02.013503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:02.014066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:02.014754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:02.015536 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:02.015987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:02.016417 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:02.047210 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Getting quotas for project 2a55bdade09f4f7497c2978a440742b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:02.057034 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Getting quotas for user f0c719b5b4a84bb89edd8d44a8d31e64 and project 2a55bdade09f4f7497c2978a440742b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:02.069112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:10:02.071632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:10:02.155414 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-99ab7907-2457-451a-afbb-fa7674fd95a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933900 Aug 24 11:10:02.156213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 192/370] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:10:02.166923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c3bad1bf-72da-423b-a2c0-9c92984bfe2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:02.167910 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c3bad1bf-72da-423b-a2c0-9c92984bfe2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:02.230155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c3bad1bf-72da-423b-a2c0-9c92984bfe2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:02.239342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c3bad1bf-72da-423b-a2c0-9c92984bfe2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1219 microversion: 2.1 time: 0.076050 Aug 24 11:10:02.240091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 179/371] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:02 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:02.734437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:02.735026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:02.741215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:02.741906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:02.742505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:02.743541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:02.744282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:02.744840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:02.920062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:02.927905 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a5409006-7850-476f-a49d-71acef5724f9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1516 microversion: 2.1 time: 0.197934 Aug 24 11:10:02.928541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 193/372] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:02 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:03.260545 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c2b898ce-df7f-4bdb-ad1d-34c619853b9a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:03.261147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c2b898ce-df7f-4bdb-ad1d-34c619853b9a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:03.340390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2b898ce-df7f-4bdb-ad1d-34c619853b9a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:03.348901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c2b898ce-df7f-4bdb-ad1d-34c619853b9a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1219 microversion: 2.1 time: 0.092664 Aug 24 11:10:03.349476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 180/373] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:03 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:04.341586 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4f8359a5-9ee5-46e1-a010-1ccacac7bf3a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'create', calling method: .version_select at 0x7f82b6c98310>, body: {"keypair": {"name": "tempest-keypair-1817095688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwWorhu07FvJ92LyP9aqLY4YGivjeKlMb7SbjcCSth1Gz35zJl5LmVictW3FJsxK8lGWOzIbkSWNQU5xuMyvXnb9I9iIkTh85FRjzt6ehgyZQy3rcvwJ3LN3KEwSOtxfA=="}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:04.362976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-4f8359a5-9ee5-46e1-a010-1ccacac7bf3a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for project 18b9988b1131422f9db644695c1df22d. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:04.370108 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a15afd61-3d8f-41d6-b856-34ca52f09f47 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:04.370712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a15afd61-3d8f-41d6-b856-34ca52f09f47 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:04.381910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-4f8359a5-9ee5-46e1-a010-1ccacac7bf3a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for user e808c04cd77d446ca2c05712868b7ce3 and project 18b9988b1131422f9db644695c1df22d. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:04.452256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4f8359a5-9ee5-46e1-a010-1ccacac7bf3a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114649 Aug 24 11:10:04.453561 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 194/374] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:10:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:04.459216 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a15afd61-3d8f-41d6-b856-34ca52f09f47 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:04.475497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a15afd61-3d8f-41d6-b856-34ca52f09f47 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1219 microversion: 2.1 time: 0.109101 Aug 24 11:10:04.476506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 181/375] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:04 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:05.497039 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-56546489-1c0b-4cae-9720-749737973af1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:05.497616 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-56546489-1c0b-4cae-9720-749737973af1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:05.578272 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-56546489-1c0b-4cae-9720-749737973af1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:05.586108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-56546489-1c0b-4cae-9720-749737973af1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1219 microversion: 2.1 time: 0.092903 Aug 24 11:10:05.586662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 195/376] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:05 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:06.298524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1130049255", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e9af3f0-b723-450b-8a9b-1100f552e746"}], "security_groups": [{"name": "tempest-securitygroup--1944701558"}], "key_name": "tempest-keypair-1817095688", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:06.403699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] validate_networks() for [('2e9af3f0-b723-450b-8a9b-1100f552e746', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:10:06.606322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:06.607020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:06.613537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:06.614011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:06.614426 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:06.615345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:06.615615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:06.616007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:06.690444 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:06.692967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:06.699604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6cce2f47-ceeb-42ac-aaca-3f58d3f62eef tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1223 microversion: 2.1 time: 0.097286 Aug 24 11:10:06.700580 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 196/377] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:06 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:06.855539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:10:06.856082 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:10:06.856605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:10:06.857004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:10:06.857401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:10:06.866502 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:06.866959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:06.867411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:06.868113 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:06.868688 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:06.868954 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:06.887476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for project 18b9988b1131422f9db644695c1df22d. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:06.892291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Getting quotas for user e808c04cd77d446ca2c05712868b7ce3 and project 18b9988b1131422f9db644695c1df22d. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:06.903794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:10:06.906261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:10:06.951797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [60f68138-a616-4987-a421-5bccfed6230b] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:10:07.723452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:07.724098 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:07.735388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:07.736127 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:07.736814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:07.737704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:07.738344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:07.739030 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:07.810255 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:07.820152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7aed5132-98f6-4a4f-bb36-29f991f6b53d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1223 microversion: 2.1 time: 0.100125 Aug 24 11:10:07.820152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 197/378] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:07 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:07.960778 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [60f68138-a616-4987-a421-5bccfed6230b] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 42424. Aug 24 11:10:07.966580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2032dec0-ea36-40c5-a7f6-527ad6107427 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.672446 Aug 24 11:10:07.967331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 182/379] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:10:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:10:07.978484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-08c81bb8-bb96-40d6-87d8-024ec8b76808 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:07.979011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-08c81bb8-bb96-40d6-87d8-024ec8b76808 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:08.036395 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-08c81bb8-bb96-40d6-87d8-024ec8b76808 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:08.043286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-08c81bb8-bb96-40d6-87d8-024ec8b76808 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1246 microversion: 2.1 time: 0.068777 Aug 24 11:10:08.043877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 198/380] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:07 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:08.841398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:08.841926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:08.850883 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:08.851626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:08.852049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:08.852743 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:08.853210 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:08.853634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:08.917382 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:08.925658 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d5dceab5-b823-4d06-b6d2-80bd4c333050 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1215 microversion: 2.1 time: 0.088759 Aug 24 11:10:08.936398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 183/381] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:08 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:09.065337 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:09.065932 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:09.072228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:09.072709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:09.073137 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:09.073828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:09.074273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:09.074693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:09.141128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:09.152488 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8f703a30-2fd0-4570-b94e-8cf147347352 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1250 microversion: 2.1 time: 0.090916 Aug 24 11:10:09.153210 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 199/382] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:09 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1250 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:09.946421 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:09.948066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:09.961147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:09.961691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:09.962143 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:09.963095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:09.963564 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:09.963987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:10.051482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:10.060365 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d539292f-b783-4204-a2c1-f03a4624f650 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1271 microversion: 2.1 time: 0.118098 Aug 24 11:10:10.060935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 184/383] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:09 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:10.177545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:10.178507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:10.187528 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:10.187998 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:10.188429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:10.189106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:10.189555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:10.189969 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:10.262584 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:10.270977 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8eb5ca9c-8f3b-481f-b25b-86b6c7212196 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1298 microversion: 2.1 time: 0.100143 Aug 24 11:10:10.271855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 200/384] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:10 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:11.082401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:11.083366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:11.091098 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.092444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.093595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.094622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.095329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.096337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.099702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-152199684", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "networks": [{"uuid": "20de87b9-83f4-4e70-9644-ae455ce3c4e4"}]}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:11.184464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] validate_networks() for [('20de87b9-83f4-4e70-9644-ae455ce3c4e4', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:10:11.192659 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:11.200480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e275f987-d9e3-496d-a602-efe0aa337c2e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1277 microversion: 2.1 time: 0.124427 Aug 24 11:10:11.201381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 185/385] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:11 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:11.293362 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:11.294272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:11.301558 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.302269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.302841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.303706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.304292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.304887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.413174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:11.433049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f1ab0075-ff8d-4c0c-a5fc-65cd663f6ddf tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1304 microversion: 2.1 time: 0.143644 Aug 24 11:10:11.434096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 186/386] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:11 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:11.647916 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:10:11.648465 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:10:11.649032 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:10:11.649541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:10:11.650030 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:10:11.660904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.661940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.662613 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.663760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:11.664813 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:11.665472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:11.683177 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Getting quotas for project 7cbdcaa21e724598bd2e6fb2c081fea9. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:11.687918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Getting quotas for user c994c78f8afe4f5d84d56f335518e2b3 and project 7cbdcaa21e724598bd2e6fb2c081fea9. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:11.699707 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:10:11.702451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:10:11.751231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fee703be-3fd4-4a7d-aba6-b4f79a043ad4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655153 Aug 24 11:10:11.758337 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 201/387] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:10:11.766678 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-48691183-af19-495d-a134-9b2c25f6298d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:11.767593 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-48691183-af19-495d-a134-9b2c25f6298d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:11.835911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-48691183-af19-495d-a134-9b2c25f6298d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:11.844001 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-48691183-af19-495d-a134-9b2c25f6298d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1213 microversion: 2.1 time: 0.083425 Aug 24 11:10:11.847105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 187/388] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:11 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:12.225072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:12.226305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:12.233253 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.234507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.235127 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.235996 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.236446 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.237161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.471520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:12.472371 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:12.483036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:12.492069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7bfcd7cc-e12f-488b-9eed-2cc76a6f4407 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.270782 Aug 24 11:10:12.493027 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 202/389] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:12 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:12.506004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.506542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.506919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.508363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.511875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.513457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.610095 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-cf622056-4267-4c3f-9764-f9a50a8336d2 req-fbc53a52-a2c3-430b-a449-87241b30171f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8054dd8-2c55-4c64-ab55-d257aa97e95c", "tag": "8fad7494-0235-40de-97e4-f19b9082e4ff"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:12.621582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-cf622056-4267-4c3f-9764-f9a50a8336d2 req-fbc53a52-a2c3-430b-a449-87241b30171f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.622722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-cf622056-4267-4c3f-9764-f9a50a8336d2 req-fbc53a52-a2c3-430b-a449-87241b30171f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.623725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-cf622056-4267-4c3f-9764-f9a50a8336d2 req-fbc53a52-a2c3-430b-a449-87241b30171f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.644771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-cf622056-4267-4c3f-9764-f9a50a8336d2 req-fbc53a52-a2c3-430b-a449-87241b30171f service nova] Creating event network-changed:8fad7494-0235-40de-97e4-f19b9082e4ff for instance b8054dd8-2c55-4c64-ab55-d257aa97e95c on hv-cinder-85427 Aug 24 11:10:12.652533 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-cf622056-4267-4c3f-9764-f9a50a8336d2 req-fbc53a52-a2c3-430b-a449-87241b30171f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046971 Aug 24 11:10:12.654231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 203/390] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:10:12.709068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:12.717681 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e56f8baf-509d-4192-940f-94a26db906d9 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.254282 Aug 24 11:10:12.719078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 188/391] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:12 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:12.866757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:12.867636 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:12.874935 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.875762 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.876355 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.877611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:12.878246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:12.878677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:12.943624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:12.951455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8f1125c9-c675-48d4-9ff6-57a0a79a3e6e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1265 microversion: 2.1 time: 0.089449 Aug 24 11:10:12.952040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 204/392] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:12 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:13.513437 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:13.514087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:13.521218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:13.521693 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:13.522129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:13.522873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:13.523348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:13.523757 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:13.669374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:13.679665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-28ed4fa7-9830-4a7c-ae77-6ce9741d3ad7 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.170896 Aug 24 11:10:13.692023 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 189/393] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:13 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:13.740079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:13.740813 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:13.746986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:13.747701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:13.748159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:13.748906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:13.749365 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:13.749772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:13.903746 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:13.913237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f6b27394-c1a3-45be-8178-a99df03b88bc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.179231 Aug 24 11:10:13.914135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 205/394] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:13 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:13.973018 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:13.974154 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:13.982198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:13.984219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:13.984737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:13.985779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:13.986837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:13.987555 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:14.076921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:14.087813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5b6698db-4158-46fa-affd-b09d3a52e12b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1271 microversion: 2.1 time: 0.118530 Aug 24 11:10:14.091670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 190/395] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:13 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:14.686913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-a144b943-40bc-4f4e-bb67-54bd619bd339 req-f40b9cd6-adf3-4fbc-a51f-2bb955d3e4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec7d6ae8-160f-49f0-ae59-b2986c77f579", "tag": "5263f317-1ef6-49d4-bae2-2c20bcd761f0"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:14.698037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a144b943-40bc-4f4e-bb67-54bd619bd339 req-f40b9cd6-adf3-4fbc-a51f-2bb955d3e4c3 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:14.698479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a144b943-40bc-4f4e-bb67-54bd619bd339 req-f40b9cd6-adf3-4fbc-a51f-2bb955d3e4c3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:14.698975 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a144b943-40bc-4f4e-bb67-54bd619bd339 req-f40b9cd6-adf3-4fbc-a51f-2bb955d3e4c3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:14.701505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:14.702375 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:14.709891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:14.710503 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:14.711582 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:14.712455 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:14.712962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:14.713113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-a144b943-40bc-4f4e-bb67-54bd619bd339 req-f40b9cd6-adf3-4fbc-a51f-2bb955d3e4c3 service nova] Creating event network-changed:5263f317-1ef6-49d4-bae2-2c20bcd761f0 for instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 on hv-cinder-85427 Aug 24 11:10:14.713440 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:14.718472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-a144b943-40bc-4f4e-bb67-54bd619bd339 req-f40b9cd6-adf3-4fbc-a51f-2bb955d3e4c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037781 Aug 24 11:10:14.719083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 206/396] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:14.857387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:14.865970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-277340b0-7ba4-4a5a-ae16-2c99196bcdd9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.168839 Aug 24 11:10:14.866529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 191/397] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:14 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:14.937597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:14.938519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:14.948495 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:14.949204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:14.949713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:14.950683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:14.951257 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:14.952045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.093517 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:15.102082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f5d27bcf-2d3c-4c9e-9126-2da9c7b43a17 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.170934 Aug 24 11:10:15.103029 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 207/398] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:14 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:15.110174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:15.110781 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:15.116979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.117429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.117889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.118572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.119020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.119470 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.258853 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:15.267532 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-482a4bdd-65fb-4327-9d09-fa50daf101c9 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.161902 Aug 24 11:10:15.268069 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 192/399] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:15 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:15.888796 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:15.890108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:15.899530 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.900293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.900897 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:15.902156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:15.902669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:15.903195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.045317 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:16.053792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cd6c10d2-1e51-44cf-8527-dde64bc1393c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.170006 Aug 24 11:10:16.054369 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 208/400] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:15 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:16.122869 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:16.123748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:16.130524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.130986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.131445 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.132130 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.132580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.133000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.268168 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:16.276540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b7c9149c-60b8-44d6-9aa3-ad99d172d244 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.157282 Aug 24 11:10:16.277085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 193/401] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:16 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:16.291206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:16.291799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:16.298685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.299187 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.299609 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.300288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:16.300757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:16.301154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:16.439787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:16.450318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5f124f65-3ff3-4cfa-ba91-08415bdecfe1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.163091 Aug 24 11:10:16.451103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 209/402] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:16 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:17.077095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:17.077687 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:17.079739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:17.085169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.085641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.086045 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.086722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.087194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.087597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.229403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:17.237449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8f27675b-1087-4fc3-bf7d-e3d9978420b0 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.166649 Aug 24 11:10:17.237986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 194/403] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:17 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:17.298375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:17.299766 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:17.306506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.307291 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.307753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.308473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.308916 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.309349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.458059 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:17.466072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-417be8ee-779a-4233-b773-f7ceb152e789 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.171726 Aug 24 11:10:17.466619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 210/404] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:17 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:17.473149 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:17.473915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:17.480031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.480738 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.481174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.481885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:17.482336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:17.482788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:17.617878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:17.626002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8fa347e9-b43d-417c-9290-1a105f758505 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.158141 Aug 24 11:10:17.626586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 195/405] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:17 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:18.004753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-9150dfb0-ede0-455c-86bf-8633bfdc169c req-d5b7f1e7-7fd5-45cd-90a1-f8a2ed0c6892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883bf98f-191c-4916-a850-5da5739c7e47", "tag": "19311a25-3d24-4dbd-ac52-e2c0befb4914"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:18.014545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9150dfb0-ede0-455c-86bf-8633bfdc169c req-d5b7f1e7-7fd5-45cd-90a1-f8a2ed0c6892 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.015196 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9150dfb0-ede0-455c-86bf-8633bfdc169c req-d5b7f1e7-7fd5-45cd-90a1-f8a2ed0c6892 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.015667 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9150dfb0-ede0-455c-86bf-8633bfdc169c req-d5b7f1e7-7fd5-45cd-90a1-f8a2ed0c6892 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.027031 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-9150dfb0-ede0-455c-86bf-8633bfdc169c req-d5b7f1e7-7fd5-45cd-90a1-f8a2ed0c6892 service nova] Creating event network-changed:19311a25-3d24-4dbd-ac52-e2c0befb4914 for instance 883bf98f-191c-4916-a850-5da5739c7e47 on hv-cinder-85427 Aug 24 11:10:18.032478 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-9150dfb0-ede0-455c-86bf-8633bfdc169c req-d5b7f1e7-7fd5-45cd-90a1-f8a2ed0c6892 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032195 Aug 24 11:10:18.033335 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 211/406] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:18.258282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:18.258851 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:18.265887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.266369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.266826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.267541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.267979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.268376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.399788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:18.408206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b75290a0-cf2f-41f5-b0d5-282232a58010 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.154085 Aug 24 11:10:18.408769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 196/407] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:18 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:18.487790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:18.488469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:18.494772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.495290 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.495713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.496389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.496830 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.497241 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.638517 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:18.646866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:18.647088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7b90e78c-fe29-4fb2-9e96-514e85f628ce tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.163512 Aug 24 11:10:18.647460 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 212/408] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:18 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:18.647615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:18.653969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.654456 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.655462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.656158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:18.656598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:18.657019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:18.660045 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:18.813613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:18.821685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4bdd743d-1e58-4d72-8add-f56dab652922 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.178688 Aug 24 11:10:18.822249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 197/409] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:18 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:19.429072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:19.429841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:19.436380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.436964 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.437638 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.438347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.438808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.439250 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.583887 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:19.586103 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-1accccce-3126-47cf-848f-151e08ee18f2 req-8502383e-31f0-4e79-ac71-cc636133dd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8054dd8-2c55-4c64-ab55-d257aa97e95c", "name": "network-vif-plugged", "status": "completed", "tag": "8fad7494-0235-40de-97e4-f19b9082e4ff"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:19.593045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-abdc0666-a45b-4a41-b06f-20a9c0d8cde2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.167796 Aug 24 11:10:19.593822 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 213/410] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:19 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:19.596663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1accccce-3126-47cf-848f-151e08ee18f2 req-8502383e-31f0-4e79-ac71-cc636133dd02 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.597158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1accccce-3126-47cf-848f-151e08ee18f2 req-8502383e-31f0-4e79-ac71-cc636133dd02 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.597556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1accccce-3126-47cf-848f-151e08ee18f2 req-8502383e-31f0-4e79-ac71-cc636133dd02 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.609024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-1accccce-3126-47cf-848f-151e08ee18f2 req-8502383e-31f0-4e79-ac71-cc636133dd02 service nova] Creating event network-vif-plugged:8fad7494-0235-40de-97e4-f19b9082e4ff for instance b8054dd8-2c55-4c64-ab55-d257aa97e95c on hv-cinder-85427 Aug 24 11:10:19.614455 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-1accccce-3126-47cf-848f-151e08ee18f2 req-8502383e-31f0-4e79-ac71-cc636133dd02 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032055 Aug 24 11:10:19.615068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 198/411] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:10:19.667549 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:19.668089 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:19.674582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.675081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.675506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.676187 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.676596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.677338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.811139 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:19.821695 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ae4bb338-fdba-4816-ac36-07a9c7cfc124 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.158072 Aug 24 11:10:19.822654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 214/412] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:19 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:19.846180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:19.846903 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:19.848916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:19.854178 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.854660 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.855095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:19.855879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:19.856363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:19.856785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:20.014075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:20.022481 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d7eb1c02-e0be-4998-bb90-562bbb7b4f60 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.183220 Aug 24 11:10:20.023063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 199/413] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:19 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:20.614497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:20.615106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:20.621778 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:20.622248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:20.622672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:20.623531 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:20.623963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:20.624376 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:20.760467 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:20.769150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8a2d01b0-9490-45ef-93f5-9993e5564b2a tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.158799 Aug 24 11:10:20.769706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 215/414] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:20 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:20.846565 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:20.849576 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:20.857288 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:20.858031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:20.858684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:20.859934 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:20.860383 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:20.860794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:20.994717 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:21.006628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a4d31f4b-d0cb-4cf6-8b5e-215a6a85455c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.166353 Aug 24 11:10:21.007480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 200/415] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:20 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:21.043588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:21.044179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:21.046131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:21.052249 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:21.052717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:21.053217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:21.053888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:21.054325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:21.054731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:21.201370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:21.209871 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-42ca1c3f-1c75-4dee-a6ab-06fceafe45d8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.170131 Aug 24 11:10:21.210461 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 216/416] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:21 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:21.792779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:21.793600 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:21.801345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:21.801770 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:21.802196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:21.802881 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:21.803364 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:21.803785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:21.843064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=18 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:21.944073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:21.952096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a1813602-9cb0-49ac-9362-cb9c0d35dc61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.164723 Aug 24 11:10:21.952758 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 201/417] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:21 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:22.031103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:22.031782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:22.033931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=4 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:22.034916 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=20 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:22.040664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.041307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.041968 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:22.042673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.043149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.043575 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:22.047162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:22.195386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:22.203260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-36d985fc-625b-4ba0-8bc9-4266f7cf14e7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.176171 Aug 24 11:10:22.204008 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 217/418] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:22 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:22.232306 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:22.233132 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:22.240034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.240504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.240928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:22.241600 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.242042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.242454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:22.373199 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:22.381504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5d2c0cda-def6-4d13-9b4d-4afaf27799db tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.154746 Aug 24 11:10:22.382078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 202/419] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:22 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:22.977149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:22.977978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:22.986912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.987424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.987852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:22.988565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:22.989013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:22.989425 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:23.127546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:23.136723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-528788b4-a7cf-41b0-a8d3-df97018c600d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1319 microversion: 2.1 time: 0.166296 Aug 24 11:10:23.137298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 218/420] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:22 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:23.224173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:23.224795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:23.231708 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:23.232116 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:23.232542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:23.233226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:23.233671 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:23.234089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:23.370800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:23.379504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d3052d5b-0192-4516-b74e-18405f601c98 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.159117 Aug 24 11:10:23.380068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 203/421] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:23 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:23.401852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:23.402706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:23.409046 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:23.409918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:23.410430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:23.411225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:23.411715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:23.412129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:23.540643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:23.548622 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-bc92452f-a81a-4f9f-9553-1507192703b5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.150638 Aug 24 11:10:23.549160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 219/422] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:23 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:24.135197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-c86f453c-3d9d-4ad6-93f5-438f5db70254 req-041e38d7-7389-49ee-a97f-5ca545b7784b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec7d6ae8-160f-49f0-ae59-b2986c77f579", "name": "network-vif-plugged", "status": "completed", "tag": "5263f317-1ef6-49d4-bae2-2c20bcd761f0"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:24.145548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c86f453c-3d9d-4ad6-93f5-438f5db70254 req-041e38d7-7389-49ee-a97f-5ca545b7784b service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.146409 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c86f453c-3d9d-4ad6-93f5-438f5db70254 req-041e38d7-7389-49ee-a97f-5ca545b7784b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.146837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c86f453c-3d9d-4ad6-93f5-438f5db70254 req-041e38d7-7389-49ee-a97f-5ca545b7784b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.157620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:24.158235 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:24.158383 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-c86f453c-3d9d-4ad6-93f5-438f5db70254 req-041e38d7-7389-49ee-a97f-5ca545b7784b service nova] Creating event network-vif-plugged:5263f317-1ef6-49d4-bae2-2c20bcd761f0 for instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 on hv-cinder-85427 Aug 24 11:10:24.164015 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-c86f453c-3d9d-4ad6-93f5-438f5db70254 req-041e38d7-7389-49ee-a97f-5ca545b7784b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032551 Aug 24 11:10:24.164885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 204/423] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:24.165625 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.166106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.166511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.167246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.167697 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.168113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.305013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:24.313545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-09880ba3-e069-4dbe-9752-75602b72eed6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1508 microversion: 2.1 time: 0.159593 Aug 24 11:10:24.314118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 220/424] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:24 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:24.401212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:24.405392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:24.419039 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.420706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.421214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.421973 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.422612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.423031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.570012 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:24.570600 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:24.576860 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.577326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.578020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.578907 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:24.579521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:24.579931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:24.602762 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:24.611540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-41803f9f-acb9-499d-8863-bb674af73a0d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.214863 Aug 24 11:10:24.612288 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 205/425] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:24 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:24.745633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:24.754275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9febe2c4-ad62-4984-a9f6-ffa7d6946da3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.188067 Aug 24 11:10:24.755112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 221/426] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:24 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:25.639390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:25.640256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:25.651775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:25.652423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:25.652997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:25.653900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:25.654343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:25.654839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:25.776734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:25.777307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:25.783893 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:25.784734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:25.785157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:25.785850 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:25.786296 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:25.786706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:25.793542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:25.801322 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f410b4cf-cb82-46b9-ad99-1cadafab3fa5 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.168299 Aug 24 11:10:25.802573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 206/427] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:25 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:25.932220 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:25.940099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cee3c1f7-bf22-49ed-ac91-7531c158f1d6 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.167086 Aug 24 11:10:25.940704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 222/428] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:25 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:26.827003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:26.827927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:26.836290 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:26.836895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:26.837453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:26.838285 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:26.838932 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:26.839463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:26.962057 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:26.962649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:26.968902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:26.969393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:26.969818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:26.970487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:26.970936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:26.972258 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:26.988922 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:26.997451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c9fd7774-9f04-40f6-b358-8c0ca480527c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.176698 Aug 24 11:10:26.998297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 207/429] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:26 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:27.107020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:27.114942 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-693140ef-e9ea-4671-90ad-d304ff13a61d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.156824 Aug 24 11:10:27.115540 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 223/430] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:26 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:28.017848 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:28.018891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:28.028621 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:28.029248 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:28.029885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:28.030912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:28.031654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:28.032247 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:28.137639 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:28.138260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:28.145241 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:28.145721 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:28.146148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:28.146840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:28.147320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:28.147734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:28.175785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:28.183699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7599a5e8-48a7-4a9a-bc4f-8ff879b650a0 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.169785 Aug 24 11:10:28.184460 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 208/431] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:28 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:28.285919 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:28.296496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c8dead5c-7883-4601-b0d5-70ea0b91cf8d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.164361 Aug 24 11:10:28.297178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 224/432] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:28 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:29.204741 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:29.205418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:29.212872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:29.213428 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:29.214093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:29.214818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:29.215300 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:29.217054 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:29.317921 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:29.318476 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:29.324697 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:29.325287 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:29.325751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:29.326553 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:29.327244 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:29.327664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:29.356635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:29.364647 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-00a01cfd-da11-401e-80ed-dcd57856ff2a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.163773 Aug 24 11:10:29.365476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 209/433] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:29 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:29.463269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:29.471423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7a25134b-2a6c-40db-bbcf-2017d4c6f153 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.157368 Aug 24 11:10:29.471987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 225/434] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:29 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:30.389189 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:30.389884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:30.397462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:30.397948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:30.398377 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:30.399070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:30.399534 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:30.399949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:30.492312 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:30.492830 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:30.499005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:30.499790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:30.500197 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:30.501061 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:30.501677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:30.502108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:30.540454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:30.548512 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cd50efe9-1d12-447d-8062-b83aac6f3106 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.166042 Aug 24 11:10:30.549964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 210/435] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:30 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:30.641026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:30.650044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2a5acc8d-4f89-4e7a-b725-80fc6bccae02 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.161907 Aug 24 11:10:30.650622 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 226/436] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:30 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:31.204806 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1574534412", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1973796702", "security_groups": [{"name": "tempest-secgroup-smoke-2002665212"}], "networks": [{"uuid": "8fa5db1b-e558-418c-a5c6-a76b00c7c6fb"}], "block_device_mapping_v2": [{"uuid": "7d2cdf08-623c-47f4-87c5-e96990ca771d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:31.322656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] validate_networks() for [('8fa5db1b-e558-418c-a5c6-a76b00c7c6fb', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:10:31.570754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:31.571352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:31.577740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.578219 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.578633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.579351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.579788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.580256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.777614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:10:31.778192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:10:31.778516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:10:31.779080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:10:31.779540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:10:31.782545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:31.789267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.789730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.790155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.790839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-afd33062-ffea-4928-9d66-c9b9e158d2f7 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1372 microversion: 2.1 time: 0.224220 Aug 24 11:10:31.790965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.791390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.791487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 227/437] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:31 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:31.791804 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.795879 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:31.796577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:31.802201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.802853 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.803312 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.803974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:31.804656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:31.805064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:31.808951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Getting quotas for project f1e957f00a814f2b89505181e43ba856. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:31.813165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Getting quotas for user 8df7721c8a694faebb58c00a0d870506 and project f1e957f00a814f2b89505181e43ba856. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:31.873078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:10:31.875352 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d2cdf08-623c-47f4-87c5-e96990ca771d',volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:10:31.948320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:31.956443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b249d3a6-9aa1-4f0d-8bf4-f1d55fb16a22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.164003 Aug 24 11:10:31.957208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 228/438] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:31 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:32.049449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c52b0239-278f-49f1-9e15-b9a282beacc8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.850708 Aug 24 11:10:32.050249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 211/439] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:10:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:10:32.061186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-82564085-d86c-43fc-8742-c103989cf8eb tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:32.061882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-82564085-d86c-43fc-8742-c103989cf8eb tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:32.119657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-82564085-d86c-43fc-8742-c103989cf8eb tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:32.127001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-82564085-d86c-43fc-8742-c103989cf8eb tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1089 microversion: 2.1 time: 0.069654 Aug 24 11:10:32.127986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 229/440] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:32 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:32.440896 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-c68ca862-5061-4299-80ff-1037ce895962 req-3683e07a-9c79-4aab-8a3f-67399b334cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883bf98f-191c-4916-a850-5da5739c7e47", "name": "network-vif-plugged", "status": "completed", "tag": "19311a25-3d24-4dbd-ac52-e2c0befb4914"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:32.451719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c68ca862-5061-4299-80ff-1037ce895962 req-3683e07a-9c79-4aab-8a3f-67399b334cb2 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:32.452319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c68ca862-5061-4299-80ff-1037ce895962 req-3683e07a-9c79-4aab-8a3f-67399b334cb2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:32.452921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c68ca862-5061-4299-80ff-1037ce895962 req-3683e07a-9c79-4aab-8a3f-67399b334cb2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:32.465659 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-c68ca862-5061-4299-80ff-1037ce895962 req-3683e07a-9c79-4aab-8a3f-67399b334cb2 service nova] Creating event network-vif-plugged:19311a25-3d24-4dbd-ac52-e2c0befb4914 for instance 883bf98f-191c-4916-a850-5da5739c7e47 on hv-cinder-85427 Aug 24 11:10:32.471738 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-c68ca862-5061-4299-80ff-1037ce895962 req-3683e07a-9c79-4aab-8a3f-67399b334cb2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040196 Aug 24 11:10:32.476062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 212/441] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:32.811486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:32.812206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:32.818567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:32.819064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:32.819493 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:32.820198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:32.820644 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:32.821056 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:32.978996 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:32.979792 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:32.980172 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:32.986421 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:32.987184 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:32.987860 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:32.988649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:32.989293 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:32.989717 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:32.990866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8da81d6e-b8d9-4b59-bed3-72ecba2144ab tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1567 microversion: 2.1 time: 0.183611 Aug 24 11:10:32.991913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 230/442] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:32 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:33.013525 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:33.014001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:33.020306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:33.020782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:33.021200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:33.021882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:33.022327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:33.022724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:33.126800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7f0a4993-54dc-4f80-8cc9-4e17165b5c83 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117061 Aug 24 11:10:33.127494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 231/443] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:10:33 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:10:33.148920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:33.149514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:33.156731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:33.157209 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:33.157604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:33.158387 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:33.158816 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:33.159609 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:33.262195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:33.271729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6d073b01-1026-4eb9-86cc-bc46d13ca9b2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.296924 Aug 24 11:10:33.283079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:33.285841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 213/444] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:32 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:33.291170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cac547ed-08ad-439b-aaab-91d853fcb2a6 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1187 microversion: 2.1 time: 0.145775 Aug 24 11:10:33.291732 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 232/445] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:33 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:34.293406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:34.295493 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:34.302552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:34.303040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:34.303473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:34.304381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:34.304811 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:34.307209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:34.312433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:34.313023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:34.320032 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:34.320511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:34.320935 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:34.321623 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:34.322160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:34.322463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:34.463381 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:34.477592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-516c05d0-4aac-4a72-b135-e7bc97640c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1195 microversion: 2.1 time: 0.168996 Aug 24 11:10:34.478345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 233/446] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:34 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1195 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:34.524126 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-a1aa5f4b-89b3-4e75-80fd-3828d6e55fb4 req-b39a8af1-526e-4ede-bbf6-d1efbbcc6d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec7d6ae8-160f-49f0-ae59-b2986c77f579", "tag": "5263f317-1ef6-49d4-bae2-2c20bcd761f0"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:34.536160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a1aa5f4b-89b3-4e75-80fd-3828d6e55fb4 req-b39a8af1-526e-4ede-bbf6-d1efbbcc6d23 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:34.536819 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a1aa5f4b-89b3-4e75-80fd-3828d6e55fb4 req-b39a8af1-526e-4ede-bbf6-d1efbbcc6d23 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:34.537389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a1aa5f4b-89b3-4e75-80fd-3828d6e55fb4 req-b39a8af1-526e-4ede-bbf6-d1efbbcc6d23 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:34.554568 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-a1aa5f4b-89b3-4e75-80fd-3828d6e55fb4 req-b39a8af1-526e-4ede-bbf6-d1efbbcc6d23 service nova] Creating event network-changed:5263f317-1ef6-49d4-bae2-2c20bcd761f0 for instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 on hv-cinder-85427 Aug 24 11:10:34.559756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-a1aa5f4b-89b3-4e75-80fd-3828d6e55fb4 req-b39a8af1-526e-4ede-bbf6-d1efbbcc6d23 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050416 Aug 24 11:10:34.560723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 234/447] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:34.601976 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:34.612234 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9d993db7-531c-48aa-b464-dd908ee80d70 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1313 microversion: 2.1 time: 0.322906 Aug 24 11:10:34.628195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 214/448] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:34 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:35.502455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:35.504153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:35.512126 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:35.512615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:35.513040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:35.513737 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:35.514363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:35.514768 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:35.635644 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:35.636233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:35.643183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:35.643908 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:35.645111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:35.646408 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:35.653857 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:35.654538 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:35.784701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:35.787248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:35.794772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8ee8bcee-1253-482f-a52a-46a121431d7c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1273 microversion: 2.1 time: 0.296572 Aug 24 11:10:35.796091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 235/449] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:35 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:35.868754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:35.877876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7bef6c2d-9dab-4b2f-85c7-f9f92d2420bd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1497 microversion: 2.1 time: 0.245905 Aug 24 11:10:35.881255 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 215/450] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:35 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:36.335533 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-8db290e4-b461-4a0e-ace9-6588db59745c req-5943d2d1-6892-45f8-8797-aef110386920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce", "tag": "2bd4251a-385e-4718-b6a2-35c629d4bbb6"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:36.345868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8db290e4-b461-4a0e-ace9-6588db59745c req-5943d2d1-6892-45f8-8797-aef110386920 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:36.346777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8db290e4-b461-4a0e-ace9-6588db59745c req-5943d2d1-6892-45f8-8797-aef110386920 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:36.347462 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8db290e4-b461-4a0e-ace9-6588db59745c req-5943d2d1-6892-45f8-8797-aef110386920 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:36.359350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-8db290e4-b461-4a0e-ace9-6588db59745c req-5943d2d1-6892-45f8-8797-aef110386920 service nova] Creating event network-changed:2bd4251a-385e-4718-b6a2-35c629d4bbb6 for instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce on hv-cinder-85427 Aug 24 11:10:36.365371 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-8db290e4-b461-4a0e-ace9-6588db59745c req-5943d2d1-6892-45f8-8797-aef110386920 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033891 Aug 24 11:10:36.366485 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 236/451] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:36.819594 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:36.820407 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:36.827104 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:36.827582 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:36.828039 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:36.828703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:36.829145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:36.829626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:36.845114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:36.890829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:36.891429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:36.898079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:36.898561 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:36.898993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:36.899711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:36.900155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:36.900570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:36.927988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:10:36.969897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:36.977855 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-104e297b-08e6-4611-91b4-4446c1bb9472 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.162324 Aug 24 11:10:36.978424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 216/452] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:36 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:37.017683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a5c88961-14c1-4b3f-9e9b-aeb7f19c3837 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "DELETE /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 204 len: 0 microversion: 2.1 time: 0.130716 Aug 24 11:10:37.018194 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 237/453] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:10:36 2022] DELETE /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:10:37.029000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:37.029650 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:37.037387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:37.037860 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:37.038281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:37.038946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:37.039615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:37.040135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:37.180476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:37.188836 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e159da3f-37f5-49fc-9d4d-f0a8c27fb8a7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1503 microversion: 2.1 time: 0.165412 Aug 24 11:10:37.189395 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 217/454] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:37 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:38.005689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:38.006492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:38.016161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:38.017765 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:38.018216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:38.018990 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:38.019471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:38.019884 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:38.169016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:38.178407 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3933bf5e-36fa-4597-9a9a-d50b4ee8f3a2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.180457 Aug 24 11:10:38.178976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 238/455] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:37 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:38.214441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:38.215036 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:38.221832 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:38.222312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:38.222740 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:38.223465 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:38.223916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:38.224334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:38.378970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:38.386758 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-96eaf807-000c-4469-b71f-defb80a677bf tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1503 microversion: 2.1 time: 0.176184 Aug 24 11:10:38.387356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 218/456] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:38 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:39.202422 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:39.203206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:39.210890 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:39.211527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:39.212051 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:39.212888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:39.213452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:39.213965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:39.364510 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:39.376307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ac60ff3d-037b-4c31-9264-5238262bfd4f tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.178413 Aug 24 11:10:39.377148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 239/457] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:39 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:39.409219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:39.409785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:39.417173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:39.417647 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:39.418298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:39.419627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:39.420344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:39.420800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:39.561964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:39.574669 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-51dcec3a-a8c7-4d2a-a1ed-c2fd106bfd7e tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1503 microversion: 2.1 time: 0.169358 Aug 24 11:10:39.575528 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 219/458] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:39 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:40.402265 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:40.403223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:40.413689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:40.414478 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:40.415221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:40.416346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:40.417087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:40.417778 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:40.557769 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:40.565803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8a2dafa3-3d2f-443d-98f6-4c973de36fca tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.170157 Aug 24 11:10:40.566395 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 240/459] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:40 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:40.597734 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:40.598449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:40.604710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:40.605205 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:40.605615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:40.606310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:40.606758 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:40.607201 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:40.755140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:40.763066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2ce127fc-f3cf-4f5b-a9d5-b5613057f167 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 200 len: 1503 microversion: 2.1 time: 0.169513 Aug 24 11:10:40.763629 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 220/460] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:40 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:40.956030 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-bb0a7886-6b21-43c8-8935-702497670e7d req-d852d684-f7f8-49f3-88ef-24d0475ab909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883bf98f-191c-4916-a850-5da5739c7e47", "name": "network-vif-deleted", "tag": "19311a25-3d24-4dbd-ac52-e2c0befb4914"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:40.966226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-bb0a7886-6b21-43c8-8935-702497670e7d req-d852d684-f7f8-49f3-88ef-24d0475ab909 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:40.966678 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-bb0a7886-6b21-43c8-8935-702497670e7d req-d852d684-f7f8-49f3-88ef-24d0475ab909 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:40.967116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-bb0a7886-6b21-43c8-8935-702497670e7d req-d852d684-f7f8-49f3-88ef-24d0475ab909 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:40.979391 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-bb0a7886-6b21-43c8-8935-702497670e7d req-d852d684-f7f8-49f3-88ef-24d0475ab909 service nova] Creating event network-vif-deleted:19311a25-3d24-4dbd-ac52-e2c0befb4914 for instance 883bf98f-191c-4916-a850-5da5739c7e47 on hv-cinder-85427 Aug 24 11:10:40.985218 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-bb0a7886-6b21-43c8-8935-702497670e7d req-d852d684-f7f8-49f3-88ef-24d0475ab909 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 Aug 24 11:10:40.986067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 241/461] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:41.586336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:41.586928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:41.593353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:41.593831 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:41.594256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:41.594938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:41.595435 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:41.595860 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:41.739508 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:41.747549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-97a3ef42-5aca-47ce-94c6-d6142f3f804b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.165143 Aug 24 11:10:41.748111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 221/462] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:41 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:41.785007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:41.785659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: 883bf98f-191c-4916-a850-5da5739c7e47] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:41.792329 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:41.792839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:41.793261 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:41.793948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:41.794393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:41.794809 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:41.808423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] HTTP exception thrown: Instance 883bf98f-191c-4916-a850-5da5739c7e47 could not be found. Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Request method failure captured: Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 HTTP/1.1 Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgcN0ol9IourgUNLX9vXvtPg8lu5ZIcf-d-E9cYF7-3Cq32SMSo-hAL-ZhURnghOInbQltB4DbBAtIY8XTxush9tGcP0DbBDwKh7-G1Y9HV0l2d3cISVWiF1z94CM0edDZWfPkmiCLfX70I2aYFslvFH6iAekl4QDRUY7JKNZgIb_Cg Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 7cbdcaa21e724598bd2e6fb2c081fea9 Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesActionsTest-812287858 Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:10:41.810081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7cbdcaa21e724598bd2e6fb2c081fea9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7cbdcaa21e724598bd2e6fb2c081fea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7cbdcaa21e724598bd2e6fb2c081fea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7cbdcaa21e724598bd2e6fb2c081fea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesActionsTest-812287858 Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 7cbdcaa21e724598bd2e6fb2c081fea9 Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesActionsTest-812287858 Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesActionsTest-812287858-project Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: c994c78f8afe4f5d84d56f335518e2b3 Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesActionsTest-812287858-project Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance 883bf98f-191c-4916-a850-5da5739c7e47 could not be found. Aug 24 11:10:41.811498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '883bf98f-191c-4916-a850-5da5739c7e47'} Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883bf98f-191c-4916-a850-5da5739c7e47 could not be found. Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:10:41.812277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883bf98f-191c-4916-a850-5da5739c7e47 could not be found. Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883bf98f-191c-4916-a850-5da5739c7e47 could not be found. Aug 24 11:10:41.813519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:10:41.815699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Returning 404 to user: Instance 883bf98f-191c-4916-a850-5da5739c7e47 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:10:41.815699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7f848222-e1da-4184-9aa5-88aa575caa9f tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47" status: 404 len: 111 microversion: 2.1 time: 0.031245 Aug 24 11:10:41.815699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 242/463] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:41 2022] GET /compute/v2.1/servers/883bf98f-191c-4916-a850-5da5739c7e47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:10:41.915261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1428041231", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "networks": [{"uuid": "20de87b9-83f4-4e70-9644-ae455ce3c4e4"}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:41.923031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:41.923768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:41.970272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] validate_networks() for [('20de87b9-83f4-4e70-9644-ae455ce3c4e4', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:10:42.357080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:10:42.357662 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:10:42.358368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:10:42.359126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:10:42.359782 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:10:42.374521 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:42.375231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:42.375850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:42.377022 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:42.377422 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:42.377836 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:42.394749 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Getting quotas for project 7cbdcaa21e724598bd2e6fb2c081fea9. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:10:42.399000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Getting quotas for user c994c78f8afe4f5d84d56f335518e2b3 and project 7cbdcaa21e724598bd2e6fb2c081fea9. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:10:42.410839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:10:42.413133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:10:42.468543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0b628ca4-95f5-467f-922a-c45b99a113e4 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557121 Aug 24 11:10:42.469231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 222/464] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:10:42.480287 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4a38560b-9f4f-4945-8cdb-fd91569b95b3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:42.481183 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4a38560b-9f4f-4945-8cdb-fd91569b95b3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:42.484408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:42.540292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4a38560b-9f4f-4945-8cdb-fd91569b95b3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:42.547301 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4a38560b-9f4f-4945-8cdb-fd91569b95b3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1214 microversion: 2.1 time: 0.071217 Aug 24 11:10:42.547904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 243/465] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:42 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:42.769364 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:42.769899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:42.776034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:42.776514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:42.776949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:42.777631 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:42.778073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:42.778483 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:42.920777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:42.928661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-80d1a001-a401-4436-9982-cbf621facd17 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.164013 Aug 24 11:10:42.929451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 223/466] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:42 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:43.568840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:43.569559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:43.575650 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:43.576228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:43.576852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:43.577543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:43.577985 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:43.578398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:43.642647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:43.651175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0d96b5f6-8c37-4f27-a012-427efd7529e8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1284 microversion: 2.1 time: 0.086550 Aug 24 11:10:43.656780 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 244/467] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:43 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:43.955087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:43.955771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:43.961706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:43.962181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:43.962603 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:43.963315 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:43.963759 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:43.964171 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:44.103659 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:44.112135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dd970ef8-3b1c-4285-99dc-d558729a5f29 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.166996 Aug 24 11:10:44.112979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 224/468] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:43 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:44.672824 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:44.673441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:44.680128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:44.680621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:44.681037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:44.681715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:44.682140 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:44.682546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:44.817601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:44.827364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-adcf4859-2e12-41fe-ac71-5b9c04fead00 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.158384 Aug 24 11:10:44.828000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 245/469] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:44 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:44.999770 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-17feeb1d-e940-4ee2-8b4d-9965bff815e3 req-2449c531-4c57-48d2-a978-6eeb6ab88d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d26cfa-8eea-4e96-bb8f-27702767a0a1", "tag": "ead84ab6-d457-4a35-af8f-0a475130c6db"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:45.011261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-17feeb1d-e940-4ee2-8b4d-9965bff815e3 req-2449c531-4c57-48d2-a978-6eeb6ab88d8c service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:45.011788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-17feeb1d-e940-4ee2-8b4d-9965bff815e3 req-2449c531-4c57-48d2-a978-6eeb6ab88d8c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:45.012196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-17feeb1d-e940-4ee2-8b4d-9965bff815e3 req-2449c531-4c57-48d2-a978-6eeb6ab88d8c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:45.023935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-17feeb1d-e940-4ee2-8b4d-9965bff815e3 req-2449c531-4c57-48d2-a978-6eeb6ab88d8c service nova] Creating event network-changed:ead84ab6-d457-4a35-af8f-0a475130c6db for instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 on hv-cinder-85427 Aug 24 11:10:45.029115 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-17feeb1d-e940-4ee2-8b4d-9965bff815e3 req-2449c531-4c57-48d2-a978-6eeb6ab88d8c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033364 Aug 24 11:10:45.029938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 225/470] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:45.133851 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:45.134469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:45.140539 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:45.141168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:45.141657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:45.142469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:45.142978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:45.143515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:45.280965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:45.289598 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a9fae29d-0a4d-4614-b4c7-186739231ef5 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.159704 Aug 24 11:10:45.290162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 246/471] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:45 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:45.849575 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:45.850351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:45.857055 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:45.857545 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:45.857972 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:45.858663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:45.859140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:45.859557 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:46.006918 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:46.015533 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4ccbc86e-9556-4d85-b622-65df63845e20 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.170874 Aug 24 11:10:46.016108 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 226/472] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:45 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:46.322255 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:46.323232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:46.334038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:46.334513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:46.334939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:46.335651 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:46.336095 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:46.336499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:46.471243 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:46.479737 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4b34d546-4878-4622-bcfb-bfd5cf1d4e82 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.165093 Aug 24 11:10:46.480311 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 247/473] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:46 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:47.037715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:47.038328 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:47.045182 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:47.045679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:47.046100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:47.046919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:47.047391 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:47.047800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:47.184257 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:47.192951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-132d194a-41fe-4b85-9097-5419f9551693 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.159692 Aug 24 11:10:47.193542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 227/474] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:47 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:47.501662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:47.502240 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:47.509199 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:47.509706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:47.510137 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:47.510829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:47.511287 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:47.511710 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:47.648815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:47.657641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1a0623ab-810f-4ba6-855a-3198bbfeb132 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.160758 Aug 24 11:10:47.658326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 248/475] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:47 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:48.213497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:48.214186 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:48.220685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:48.221195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:48.221622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:48.222297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:48.222723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:48.223176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:48.359943 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:48.367978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b3710b2a-750f-4053-92e1-3099238a8235 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.158531 Aug 24 11:10:48.368772 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 228/476] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:48 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:48.679704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:48.680273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:48.686429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:48.686904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:48.687387 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:48.688096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:48.688537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:48.688947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:48.827402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:48.836999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e371c2ba-dec7-4ff9-9f46-8866745d283e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.161347 Aug 24 11:10:48.837579 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 249/477] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:48 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:49.394842 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:49.396054 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:49.402788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:49.403312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:49.403812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:49.404525 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:49.404978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:49.405394 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:49.543410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:49.551598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a9fe2d72-a2ac-44f8-9593-f51847329e5c tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.163306 Aug 24 11:10:49.552686 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 229/478] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:49 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:49.865444 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:49.866040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:49.872404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:49.872904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:49.873295 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:49.873991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:49.874434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:49.874845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:50.023890 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:50.032110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-dab05d9f-3a91-4781-a4d6-40eb9e6105b3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.172760 Aug 24 11:10:50.032676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 250/479] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:49 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:50.331606 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7421bc7d-8c01-4685-b5b5-3bb0b5d720ed", "device": "/dev/sdb"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:50.336066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:50.339263 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:50.346995 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:50.347748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:50.348490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:50.349165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:50.349612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:50.350031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:50.573815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:50.574406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:50.581474 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:50.581943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:50.582356 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:50.583089 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:50.583556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:50.583965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:50.718499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:50.726791 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ffc928bc-eb8e-469d-b9b7-5802ed254b39 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.156962 Aug 24 11:10:50.727364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 251/480] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:50 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:51.061767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:51.062463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:51.064422 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:51.070761 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:51.071672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:51.072419 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:51.073587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:51.074171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:51.074604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:51.212130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:51.220863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-effafaa3-5e06-4a86-b7ca-b3426ba99d9d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.164427 Aug 24 11:10:51.221456 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 252/481] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:51 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:10:51.226453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-7e58de7b-2c2d-4b07-93fc-2507a32ba20d req-0eaf26e0-3734-4fa6-b804-81849a5c2cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce", "name": "network-vif-plugged", "status": "completed", "tag": "2bd4251a-385e-4718-b6a2-35c629d4bbb6"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:51.235652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-7e58de7b-2c2d-4b07-93fc-2507a32ba20d req-0eaf26e0-3734-4fa6-b804-81849a5c2cfd service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:51.236120 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-7e58de7b-2c2d-4b07-93fc-2507a32ba20d req-0eaf26e0-3734-4fa6-b804-81849a5c2cfd service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:51.236521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-7e58de7b-2c2d-4b07-93fc-2507a32ba20d req-0eaf26e0-3734-4fa6-b804-81849a5c2cfd service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:51.247909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-7e58de7b-2c2d-4b07-93fc-2507a32ba20d req-0eaf26e0-3734-4fa6-b804-81849a5c2cfd service nova] Creating event network-vif-plugged:2bd4251a-385e-4718-b6a2-35c629d4bbb6 for instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce on hv-cinder-85427 Aug 24 11:10:51.253388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-7e58de7b-2c2d-4b07-93fc-2507a32ba20d req-0eaf26e0-3734-4fa6-b804-81849a5c2cfd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Aug 24 11:10:51.254025 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 253/482] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:51.749417 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:51.750217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:51.759105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:51.759781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:51.760198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:51.760903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:51.761348 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:51.761753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:51.776518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:51.903978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:51.915142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-187be5b7-2caf-497d-b388-bd3f4669a528 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.170495 Aug 24 11:10:51.915708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 254/483] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:51 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:52.245871 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:52.246944 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:52.256701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:52.257475 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:52.258165 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:52.259326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:52.260046 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:52.260631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:52.384219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:52.405921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:52.407163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:52.416276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ff019b76-5e69-4164-ade7-7286a1afb22c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.177722 Aug 24 11:10:52.416836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 255/484] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:52 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:52.939755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:52.940355 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:52.946246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:52.949857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:52.950484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:52.951026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:52.952128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:52.952577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:52.952997 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:52.972834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e6c86fe5-2339-46b8-9f5c-b9726bcdf6a3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "POST /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.646402 Aug 24 11:10:52.982479 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 230/485] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:10:50 2022] POST /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c/os-volume_attachments => generated 194 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:53.120750 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:53.129886 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ff05c3ee-abaf-46de-81b8-fe31946a10a5 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.194621 Aug 24 11:10:53.130560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 256/486] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:52 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:53.438133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:53.438819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:53.445605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:53.446088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:53.446523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:53.447251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:53.447703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:53.448126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:53.590387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:53.601697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f757d88a-6727-446a-9cee-997136baa499 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.168122 Aug 24 11:10:53.602262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 231/487] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:53 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:54.155135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:54.155973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:54.165240 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:54.165744 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:54.166166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:54.166845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:54.167336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:54.167744 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:54.316076 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:54.324337 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-353785da-3a75-46f6-b954-1e69f6e2d6f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.175519 Aug 24 11:10:54.324822 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 257/488] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:54 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:54.630347 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:54.631760 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:54.643237 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:54.644034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:54.644699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:54.645884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:54.646725 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:54.647247 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:54.787623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:54.795639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-46a1b732-a0d0-4d96-afca-930c7b9b5e3d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1261 microversion: 2.1 time: 0.172164 Aug 24 11:10:54.796231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 232/489] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:54 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:55.199851 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-9137c6bd-6737-4612-82af-de875191110f req-dba64277-861d-402e-bdac-670c68afcfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d26cfa-8eea-4e96-bb8f-27702767a0a1", "name": "network-vif-plugged", "status": "completed", "tag": "ead84ab6-d457-4a35-af8f-0a475130c6db"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:55.210867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9137c6bd-6737-4612-82af-de875191110f req-dba64277-861d-402e-bdac-670c68afcfb8 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:55.211367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9137c6bd-6737-4612-82af-de875191110f req-dba64277-861d-402e-bdac-670c68afcfb8 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:55.211789 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9137c6bd-6737-4612-82af-de875191110f req-dba64277-861d-402e-bdac-670c68afcfb8 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:55.223363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-9137c6bd-6737-4612-82af-de875191110f req-dba64277-861d-402e-bdac-670c68afcfb8 service nova] Creating event network-vif-plugged:ead84ab6-d457-4a35-af8f-0a475130c6db for instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 on hv-cinder-85427 Aug 24 11:10:55.229541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-9137c6bd-6737-4612-82af-de875191110f req-dba64277-861d-402e-bdac-670c68afcfb8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Aug 24 11:10:55.230167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 258/490] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:55.345898 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:55.346492 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:55.354393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:55.354877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:55.355345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:55.356044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:55.356494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:55.356921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:55.359824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:10:55.520007 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:55.531276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-08a90604-5c9d-4d6e-80a8-044087f2072b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.188221 Aug 24 11:10:55.531909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 233/491] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:55 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:55.820334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:55.821289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:55.829168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:55.829855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:55.830334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:55.831092 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:55.831544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:55.832171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:55.995951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:56.006230 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-56b3451b-89b6-4df6-bfd6-1feea27b5518 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1445 microversion: 2.1 time: 0.192263 Aug 24 11:10:56.006828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 259/492] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:55 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1445 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:56.030007 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:56.030851 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:56.037344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:56.037830 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:56.038256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:56.038950 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:56.039434 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:56.039850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:56.187751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:56.196198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-15e426ea-af26-4202-889e-65e1e77f442c tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1445 microversion: 2.1 time: 0.170237 Aug 24 11:10:56.196819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 234/493] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:56 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:56.553289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:56.553949 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:56.560294 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:56.560766 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:56.561197 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:56.561884 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:56.562416 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:56.562808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:56.779519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:56.789615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-86e21294-4627-4b07-b066-3d84c1d2cd22 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.240394 Aug 24 11:10:56.790184 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 260/494] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:56 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:57.810018 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:57.810817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:57.817571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:57.818199 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:57.818611 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:57.819523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:57.819963 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:57.820554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:58.067694 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:58.076440 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9734d9ee-dc4c-422a-bd8c-79aadadbcedd tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1314 microversion: 2.1 time: 0.270274 Aug 24 11:10:58.077640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 235/495] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:57 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:58.395521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-49b46c3e-a369-4ce9-a2b7-261120f6aa52 req-99bff6fc-a734-4997-9c27-fad5bce7f1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce", "tag": "2bd4251a-385e-4718-b6a2-35c629d4bbb6"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:10:58.401546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-49b46c3e-a369-4ce9-a2b7-261120f6aa52 req-99bff6fc-a734-4997-9c27-fad5bce7f1c5 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:58.402006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-49b46c3e-a369-4ce9-a2b7-261120f6aa52 req-99bff6fc-a734-4997-9c27-fad5bce7f1c5 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:58.402416 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-49b46c3e-a369-4ce9-a2b7-261120f6aa52 req-99bff6fc-a734-4997-9c27-fad5bce7f1c5 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:58.414666 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-49b46c3e-a369-4ce9-a2b7-261120f6aa52 req-99bff6fc-a734-4997-9c27-fad5bce7f1c5 service nova] Creating event network-changed:2bd4251a-385e-4718-b6a2-35c629d4bbb6 for instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce on hv-cinder-85427 Aug 24 11:10:58.419803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-49b46c3e-a369-4ce9-a2b7-261120f6aa52 req-99bff6fc-a734-4997-9c27-fad5bce7f1c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031738 Aug 24 11:10:58.420396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 261/496] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:10:59.099839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:59.100491 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:59.108364 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:59.108859 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:59.109288 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:59.109990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:59.110444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:59.110842 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:59.245474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:10:59.253422 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d963465a-23ec-4129-9b5a-b02d7b05580b tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1497 microversion: 2.1 time: 0.157767 Aug 24 11:10:59.253967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 236/497] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:59 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:10:59.848934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:59.849910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:59.857768 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:59.858245 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:59.858654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:59.859383 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:59.859956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:59.860486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:59.887729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:10:59.974823 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e8cb1dc5-8deb-45d6-9d01-dadd6b5db2f7 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 204 len: 0 microversion: 2.1 time: 0.130604 Aug 24 11:10:59.975650 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 262/498] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:10:59 2022] DELETE /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:10:59.984609 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:10:59.985581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:10:59.991878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:59.992610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:59.993201 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:10:59.994061 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:10:59.994505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:10:59.995262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:00.135527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:00.144612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f0eb71d0-dc4d-48f0-95d6-6443d227e746 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1503 microversion: 2.1 time: 0.164319 Aug 24 11:11:00.146932 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 237/499] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:10:59 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:01.177778 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:01.178831 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:01.186245 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:01.186967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:01.187710 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:01.188778 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:01.189490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:01.190143 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:01.336652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:01.344372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7024371c-6ff1-42bc-878d-31e3adaf7d32 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1503 microversion: 2.1 time: 0.174283 Aug 24 11:11:01.344905 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 263/500] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:01 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:02.370856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:02.371803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:02.382344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:02.382830 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:02.383794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:02.384066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:02.384518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:02.384938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:02.525689 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:02.534203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aac3ab7b-b3c2-4e59-861c-3d2ce86a1ed2 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1503 microversion: 2.1 time: 0.169973 Aug 24 11:11:02.534739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 238/501] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:02 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:03.556022 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:03.556635 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:03.563262 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:03.563698 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:03.564153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:03.564823 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:03.565260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:03.565668 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:03.709053 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:03.717138 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6e6e6756-1214-4c98-8350-a18b3bd95ec8 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1503 microversion: 2.1 time: 0.165196 Aug 24 11:11:03.717703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 264/502] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:03 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:04.739648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:04.740256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:04.747400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:04.747900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:04.748322 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:04.749009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:04.749452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:04.749864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:04.884640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:04.892889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0f5fa5ce-aa3c-4e4e-a71e-aad23a4e5bfa tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1503 microversion: 2.1 time: 0.157921 Aug 24 11:11:04.893492 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 239/503] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:04 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:05.914395 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:05.914977 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:05.922325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:05.922796 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:05.923250 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:05.923924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:05.924361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:05.924763 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:06.065041 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:06.075121 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-90676d6e-6a5f-4b96-b1cf-9bf2c9edfab1 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1503 microversion: 2.1 time: 0.164436 Aug 24 11:11:06.075674 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 265/504] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:05 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:06.741936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-2413c4c0-5fa8-411a-a258-304a3e8c8a5d req-c024dcb0-db52-4afd-8dd0-0a527758461d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d26cfa-8eea-4e96-bb8f-27702767a0a1", "name": "network-vif-deleted", "tag": "ead84ab6-d457-4a35-af8f-0a475130c6db"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:06.752808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2413c4c0-5fa8-411a-a258-304a3e8c8a5d req-c024dcb0-db52-4afd-8dd0-0a527758461d service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:06.753288 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2413c4c0-5fa8-411a-a258-304a3e8c8a5d req-c024dcb0-db52-4afd-8dd0-0a527758461d service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:06.753709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2413c4c0-5fa8-411a-a258-304a3e8c8a5d req-c024dcb0-db52-4afd-8dd0-0a527758461d service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:06.765049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-2413c4c0-5fa8-411a-a258-304a3e8c8a5d req-c024dcb0-db52-4afd-8dd0-0a527758461d service nova] Creating event network-vif-deleted:ead84ab6-d457-4a35-af8f-0a475130c6db for instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 on hv-cinder-85427 Aug 24 11:11:06.770159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-2413c4c0-5fa8-411a-a258-304a3e8c8a5d req-c024dcb0-db52-4afd-8dd0-0a527758461d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032044 Aug 24 11:11:06.770736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 240/505] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:11:07.100486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:07.101660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:07.111765 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:07.112558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:07.113270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:07.114393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:07.115147 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:07.116161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:07.180150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:07.187876 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-bef75037-d4b1-4b1c-a9c3-bcdfbfee4685 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1461 microversion: 2.1 time: 0.094017 Aug 24 11:11:07.188431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 266/506] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:07 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:07.787917 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:07.788709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:07.797506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:07.798229 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:07.798891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:07.799875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:07.800507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:07.801117 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:07.827837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4c750737-8f55-46ab-b4c4-8284d84cead2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/ips" status: 200 len: 145 microversion: 2.1 time: 0.046707 Aug 24 11:11:07.828609 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 241/507] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:11:07 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:11:08.209182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:08.210147 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:08.216525 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:08.217000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:08.217424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:08.218101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:08.218515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:08.218958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:08.284135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:08.292386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cb9d084a-281e-46ce-a6d5-c316cbe764c3 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1461 microversion: 2.1 time: 0.087044 Aug 24 11:11:08.292930 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 267/508] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:08 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:09.317420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:09.318209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:09.328531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:09.329214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:09.329829 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:09.330784 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:09.331502 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:09.332111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:09.409644 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:09.421745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-16436f71-d36e-45ad-b753-10dd4890bd7d tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1299 microversion: 2.1 time: 0.111139 Aug 24 11:11:09.422543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 242/509] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:09 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:10.443497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:10.444756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:10.451559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:10.452037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:10.452454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:10.453152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:10.453595 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:10.454012 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:10.487211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:10.487600 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:10.488019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:10.488448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lazy-loading 'fault' on Instance uuid e0d26cfa-8eea-4e96-bb8f-27702767a0a1 {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:11:10.535679 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:10.543490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-840d8e44-ebf1-4595-976f-91fe43cba93a tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1304 microversion: 2.1 time: 0.103843 Aug 24 11:11:10.544123 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 268/510] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:10 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:11.564485 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:11.565036 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:11.572130 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:11.572586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:11.573044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:11.573725 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:11.574172 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:11.574587 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:11.607745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:11.608215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:11.608776 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:11.609227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lazy-loading 'fault' on Instance uuid e0d26cfa-8eea-4e96-bb8f-27702767a0a1 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:11:11.659675 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c994c78f8afe4f5d84d56f335518e2b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cbdcaa21e724598bd2e6fb2c081fea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:11.667501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a88440b4-5158-446b-9df5-63936b2ff930 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 200 len: 1304 microversion: 2.1 time: 0.106869 Aug 24 11:11:11.668064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 243/511] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:11 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:12.691541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:12.692337 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] [instance: e0d26cfa-8eea-4e96-bb8f-27702767a0a1] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:12.699318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:12.699794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:12.700223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:12.700901 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:12.701343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:12.701753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:12.715981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] HTTP exception thrown: Instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 could not be found. Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Request method failure captured: Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 HTTP/1.1 Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgcN0ol9IourgUNLX9vXvtPg8lu5ZIcf-d-E9cYF7-3Cq32SMSo-hAL-ZhURnghOInbQltB4DbBAtIY8XTxush9tGcP0DbBDwKh7-G1Y9HV0l2d3cISVWiF1z94CM0edDZWfPkmiCLfX70I2aYFslvFH6iAekl4QDRUY7JKNZgIb_Cg Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 7cbdcaa21e724598bd2e6fb2c081fea9 Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesActionsTest-812287858 Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:11:12.717656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7cbdcaa21e724598bd2e6fb2c081fea9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7cbdcaa21e724598bd2e6fb2c081fea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7cbdcaa21e724598bd2e6fb2c081fea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7cbdcaa21e724598bd2e6fb2c081fea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesActionsTest-812287858 Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 7cbdcaa21e724598bd2e6fb2c081fea9 Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesActionsTest-812287858 Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesActionsTest-812287858-project Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: c994c78f8afe4f5d84d56f335518e2b3 Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesActionsTest-812287858-project Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 could not be found. Aug 24 11:11:12.719283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'e0d26cfa-8eea-4e96-bb8f-27702767a0a1'} Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 could not be found. Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:11:12.720198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 could not be found. Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 could not be found. Aug 24 11:11:12.721708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:12.723106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] Returning 404 to user: Instance e0d26cfa-8eea-4e96-bb8f-27702767a0a1 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:11:12.723106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-66e6fc77-840e-4311-8155-0e18fe780057 tempest-VolumesActionsTest-812287858 tempest-VolumesActionsTest-812287858-project] 10.222.0.79 "GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1" status: 404 len: 111 microversion: 2.1 time: 0.033246 Aug 24 11:11:12.723106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 269/512] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:12 2022] GET /compute/v2.1/servers/e0d26cfa-8eea-4e96-bb8f-27702767a0a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:11:13.180812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b13fa5f-8f1c-4d90-9cb3-a8e47d945eb2"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:13.183231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:13.189638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:13.190000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:13.190433 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:13.191150 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:13.191605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:13.192150 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:16.076377 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-32eea38c-9a29-4b25-b0f8-544cf09bbb25 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.900103 Aug 24 11:11:16.077059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 244/513] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:11:13 2022] POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-volume_attachments => generated 194 bytes in 2902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:11:26.192635 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:26.193184 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:26.198922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:26.199803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:26.201292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:26.201953 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:26.202541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:26.203406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:26.204004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:26.204418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:26.344757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lazy-loading 'services' on Instance uuid b8054dd8-2c55-4c64-ab55-d257aa97e95c {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:11:26.477818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-20177983-1d04-49b9-9a0c-98e29c30b423 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c/os-volume_attachments/7421bc7d-8c01-4685-b5b5-3bb0b5d720ed" status: 202 len: 0 microversion: 2.1 time: 0.288937 Aug 24 11:11:26.478751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 270/514] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:11:26 2022] DELETE /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c/os-volume_attachments/7421bc7d-8c01-4685-b5b5-3bb0b5d720ed => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:11:27.673248 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=31 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:27.675807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:27.682047 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:27.682922 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:27.693003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:27.693484 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:27.693957 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:27.694653 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:27.695820 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:27.696265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:27.722691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1fb54b1f-9155-4a13-a1c3-f51224703802 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/ips" status: 200 len: 151 microversion: 2.20 time: 0.050853 Aug 24 11:11:27.730537 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 245/515] 10.222.0.79 () {60 vars in 1289 bytes} [Wed Aug 24 11:11:27 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:11:30.187930 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:30.188618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:30.195370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:30.195949 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:30.196233 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:30.196931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:30.197375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:30.197803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:30.221686 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lazy-loading 'flavor' on Instance uuid 2e7358f8-2cd1-41ac-a439-4630ad8630bc {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:11:30.499347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2834ae2c-1f55-4473-8223-c3f08a76d4e3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/action" status: 202 len: 0 microversion: 2.20 time: 0.316864 Aug 24 11:11:30.500071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 271/516] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 24 11:11:30 2022] POST /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:11:30.510081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:30.510789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:30.517008 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:30.517498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:30.517981 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:30.518773 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:30.519283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:30.519706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:30.664471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:30.673489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:30.675273 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:30.676621 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0947f97d-c581-49ac-ac21-1f6fe45e204e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.171520 Aug 24 11:11:30.683119 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 246/517] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:30 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:31.702157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:31.702756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:31.714860 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:31.715357 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:31.716770 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:31.717627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:31.721084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:31.721798 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:31.894909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:31.913166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:31.922887 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:31.924343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-113724fe-5397-458a-a8f8-055e9477a8cc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.227544 Aug 24 11:11:31.925523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 272/518] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:31 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:32.280142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-df654ec7-bf6a-4376-a03d-f3e17ab8eea5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:32.287649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df654ec7-bf6a-4376-a03d-f3e17ab8eea5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:32.288136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df654ec7-bf6a-4376-a03d-f3e17ab8eea5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:32.288663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df654ec7-bf6a-4376-a03d-f3e17ab8eea5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:32.352956 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-df654ec7-bf6a-4376-a03d-f3e17ab8eea5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Going to try to stop instance {{(pid=120788) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:11:32.404790 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-df654ec7-bf6a-4376-a03d-f3e17ab8eea5 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action" status: 202 len: 0 microversion: 2.1 time: 0.128552 Aug 24 11:11:32.409073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 247/519] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:11:32 2022] POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:11:32.422948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:32.423634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:32.441940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:32.441940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:32.441940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:32.441940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:32.442410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:32.442410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:32.616441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:32.625501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6dce1996-7aad-4a49-914b-1a9d79b9857b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.214810 Aug 24 11:11:32.631430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 273/520] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:32 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:11:32.948592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:32.949754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:32.960852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:32.961422 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:32.961753 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:32.962449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:32.962893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:32.963333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:33.118970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:33.133234 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:33.135616 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:33.138493 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-02fafe65-2eb5-4b38-87ed-b4fa6e08c050 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.193799 Aug 24 11:11:33.143093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 248/521] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:32 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:33.647368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:33.648841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:33.656834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:33.658253 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:33.658703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:33.659647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:33.660462 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:33.661045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:33.823372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:33.835097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3f03a17d-a904-45d5-9fdc-3da4bb2c84aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.191162 Aug 24 11:11:33.836524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 274/522] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:33 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:34.138990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:34.139610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:34.147447 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.148016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.148681 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.149664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.150127 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.150761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.168239 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:34.169142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:34.175520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.176222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.177248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.178374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.179347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.180335 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.182519 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:11:34.293804 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5fe0adfd-a22d-45db-9a2d-329db6db9d61 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 204 len: 0 microversion: 2.1 time: 0.156349 Aug 24 11:11:34.294971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 249/523] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:11:34 2022] DELETE /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:11:34.315701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:34.318864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:34.326933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.327913 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.328612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.329804 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.330523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.331497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.377339 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:34.390045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:34.392014 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:34.393487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3b1886ac-6d52-4354-bfdf-0f987249b01d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.233560 Aug 24 11:11:34.407380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 275/524] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:34 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:34.507709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:34.516185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-70ebcbdb-40c9-4f54-856c-81aa2746ddaa tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1514 microversion: 2.1 time: 0.214424 Aug 24 11:11:34.517094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 250/525] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:34 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:34.857090 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:34.858491 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:34.864659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.865445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.865985 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:34.866842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:34.867312 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:34.867720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:35.011154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:35.019964 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c2143d93-d41e-44fe-a505-b9e6dd1afae6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.166652 Aug 24 11:11:35.031374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 276/526] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:34 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:35.418112 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:35.418814 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:35.430753 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:35.431511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:35.431988 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:35.433033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:35.433299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:35.433721 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:35.539524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:35.540891 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:35.550591 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:35.552964 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:35.554212 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:35.556018 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:35.556936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:35.557875 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:35.590775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:35.599602 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:35.601292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:35.602464 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a0fe16ff-4e59-44ca-97fc-172900500766 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.188372 Aug 24 11:11:35.607088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 251/527] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:35 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:35.747883 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:35.756103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-37151ed0-cd8b-4079-9aa5-e803298f5e41 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1514 microversion: 2.1 time: 0.221493 Aug 24 11:11:35.757049 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 277/528] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:35 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:36.042707 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:36.043501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:36.049984 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.050474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.050941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.053971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.053971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.053971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.205106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:36.214138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-199e2e98-5740-4619-972d-2beb962e93df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.175476 Aug 24 11:11:36.214818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 252/529] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:36 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:36.626924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:36.627623 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:36.637632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.638572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.639221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.639951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.640593 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.641232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.783325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:36.784648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:36.793860 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.794664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.795302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.796236 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:36.796873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:36.797460 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:36.815610 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:36.825781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:36.827592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:36.828848 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e734ad94-45f1-47a0-a2c7-3e5509f26a39 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.205932 Aug 24 11:11:36.829829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 278/530] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:36 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:36.972649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:36.981942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fcc8558f-9f23-4d2f-aea0-d088570c34dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1514 microversion: 2.1 time: 0.203238 Aug 24 11:11:36.983266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 253/531] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:36 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:11:37.236571 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:37.237182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:37.244073 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:37.244611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:37.245106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:37.246012 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:37.246627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:37.247310 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:37.436672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:37.454483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ec71af54-a888-45ab-88d8-0c4c8f4f9b5e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.222358 Aug 24 11:11:37.455270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 279/532] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:37 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:37.488812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-fa3025ef-d6a8-4aa4-a23f-c3c7aeabcac1 req-f55b2666-cf3f-4cf7-b09a-42e0e0052b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8054dd8-2c55-4c64-ab55-d257aa97e95c", "name": "network-vif-deleted", "tag": "8fad7494-0235-40de-97e4-f19b9082e4ff"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:37.504159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fa3025ef-d6a8-4aa4-a23f-c3c7aeabcac1 req-f55b2666-cf3f-4cf7-b09a-42e0e0052b3b service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:37.504783 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fa3025ef-d6a8-4aa4-a23f-c3c7aeabcac1 req-f55b2666-cf3f-4cf7-b09a-42e0e0052b3b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:37.505287 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fa3025ef-d6a8-4aa4-a23f-c3c7aeabcac1 req-f55b2666-cf3f-4cf7-b09a-42e0e0052b3b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:37.518923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-fa3025ef-d6a8-4aa4-a23f-c3c7aeabcac1 req-f55b2666-cf3f-4cf7-b09a-42e0e0052b3b service nova] Creating event network-vif-deleted:8fad7494-0235-40de-97e4-f19b9082e4ff for instance b8054dd8-2c55-4c64-ab55-d257aa97e95c on hv-cinder-85427 Aug 24 11:11:37.525060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-fa3025ef-d6a8-4aa4-a23f-c3c7aeabcac1 req-f55b2666-cf3f-4cf7-b09a-42e0e0052b3b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041001 Aug 24 11:11:37.527216 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 254/533] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:11:37.853427 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:37.854301 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:37.861134 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:37.861896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:37.862566 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:37.863517 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:37.864392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:37.865003 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.015377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:38.025583 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:38.028796 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:38.030300 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:38.030507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:38.032302 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0c2c85e7-26bb-498d-93e8-5a4305742439 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.182826 Aug 24 11:11:38.032957 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 280/534] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:37 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:38.041059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:38.041634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:38.042276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.043004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:38.043498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:38.043899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.087674 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:38.088275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:38.088829 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.089390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lazy-loading 'fault' on Instance uuid b8054dd8-2c55-4c64-ab55-d257aa97e95c {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:11:38.142994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:38.163450 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-19f4e06d-5c5d-49fd-b092-b5636e454bc3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 200 len: 1309 microversion: 2.1 time: 0.148810 Aug 24 11:11:38.164519 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 255/535] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:38 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:38.476420 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:38.477294 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:38.483945 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:38.484659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:38.485311 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.486268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:38.486910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:38.487553 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:38.651971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:38.662464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9e705695-0950-47aa-97fe-21b5d5c3b649 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.189892 Aug 24 11:11:38.663149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 281/536] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:38 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:39.060299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:39.061389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:39.068865 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.069350 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.069896 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.070595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.071216 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.071634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.191797 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:39.192400 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: b8054dd8-2c55-4c64-ab55-d257aa97e95c] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:39.198948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.199503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.201338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.202278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.203102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.203880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.223216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] HTTP exception thrown: Instance b8054dd8-2c55-4c64-ab55-d257aa97e95c could not be found. Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Request method failure captured: Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c HTTP/1.1 Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgcH9oekNPZWqT2LZWG-jchg4qlmC2vBHmgPsLRSJRZaNYQFCxrZDRIEfF89VkPt3RWaGSJsAT8JyidA30pdook_Sog4x2IRz6Ym4wueLsnIOO68WAYixZ-gcBJOaFuryC9-U3GF9y97Dj4TTj9SKWlmBToBugVCJw4v2PeZWzjNZ5w Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 2a55bdade09f4f7497c2978a440742b8 Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesSnapshotTestJSON-364052716 Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:11:39.225455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a55bdade09f4f7497c2978a440742b8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a55bdade09f4f7497c2978a440742b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a55bdade09f4f7497c2978a440742b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a55bdade09f4f7497c2978a440742b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesSnapshotTestJSON-364052716 Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 2a55bdade09f4f7497c2978a440742b8 Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-364052716 Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesSnapshotTestJSON-364052716-project Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: f0c719b5b4a84bb89edd8d44a8d31e64 Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesSnapshotTestJSON-364052716-project Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance b8054dd8-2c55-4c64-ab55-d257aa97e95c could not be found. Aug 24 11:11:39.226938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'b8054dd8-2c55-4c64-ab55-d257aa97e95c'} Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8054dd8-2c55-4c64-ab55-d257aa97e95c could not be found. Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:11:39.227818 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8054dd8-2c55-4c64-ab55-d257aa97e95c could not be found. Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8054dd8-2c55-4c64-ab55-d257aa97e95c could not be found. Aug 24 11:11:39.229065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:11:39.230156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Returning 404 to user: Instance b8054dd8-2c55-4c64-ab55-d257aa97e95c could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:11:39.230156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-43edaada-7992-4039-90cb-2622aae77aa2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c" status: 404 len: 111 microversion: 2.1 time: 0.039882 Aug 24 11:11:39.230156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 282/537] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:39 2022] GET /compute/v2.1/servers/b8054dd8-2c55-4c64-ab55-d257aa97e95c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:11:39.379363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:39.391537 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:39.396406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:39.398861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d84ff554-166a-49bc-848b-31e34a090d3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.343009 Aug 24 11:11:39.400183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 256/538] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:39 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:39.687504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:39.689165 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:39.700061 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.700874 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.701529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.702488 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:39.703006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:39.703516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:39.903438 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:39.915296 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d13a7180-8ce5-40ae-8c49-b076b196f7d1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.234169 Aug 24 11:11:39.915866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 283/539] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:39 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:40.431225 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:40.432228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:40.443109 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:40.443953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:40.444768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:40.445476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:40.445915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:40.446324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:40.581877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:40.590406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:40.591937 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:40.593090 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b1029512-0835-4a84-a4a6-e45a29a2cfc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.168411 Aug 24 11:11:40.593646 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 257/540] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:40 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:40.938556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:40.939454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:40.948919 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:40.949629 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:40.950217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:40.951324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:40.952056 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:40.952688 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:40.973145 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:41.088669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:41.101620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9581111c-84e5-435b-868d-93e0b545e2b2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.168472 Aug 24 11:11:41.102192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 284/541] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:40 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:41.619024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:41.619834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:41.627345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:41.627825 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:41.628249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:41.628933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:41.629722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:41.630138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:41.785267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:41.794033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:41.795561 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:41.796719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8ab4ca06-a5f6-4eef-b8c9-6faff246cf96 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.184020 Aug 24 11:11:41.797281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 258/542] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:41 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:42.126475 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:42.127484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:42.135854 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:42.136333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:42.136779 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:42.137472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:42.137915 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:42.138328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:42.272389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:42.281379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9d59dff6-048b-44eb-9ba3-5fd51e3edfa1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.161548 Aug 24 11:11:42.282256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 285/543] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:42 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:42.822828 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:42.823447 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:42.830274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:42.830774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:42.831286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:42.831964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:42.832406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:42.832816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:42.851212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:42.974845 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:42.983206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:42.984668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:42.985800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0eb368e2-89a6-40ca-9f77-e9ad0cec9c87 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.168098 Aug 24 11:11:42.986345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 259/544] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:42 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:43.305857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:43.306557 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:43.314279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:43.314869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:43.315442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:43.316261 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:43.316835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:43.317359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:43.448693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:43.456898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c797ebb3-64c3-4093-9e3f-4104a5560cfc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.156960 Aug 24 11:11:43.457484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 286/545] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:43 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:44.014197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:44.015116 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:44.024802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:44.025283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:44.025712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:44.026393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:44.026842 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:44.027300 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:44.166641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:44.175144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:44.176622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:44.177760 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-acfe435f-4f6d-436b-9f80-7d22d4535c36 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.170772 Aug 24 11:11:44.178529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 260/546] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:44 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:44.478040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:44.478654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:44.484760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:44.485240 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:44.485665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:44.486340 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:44.487017 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:44.487467 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:44.624899 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:44.633288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-80d40197-0285-4754-80f8-58fbb0568452 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.159373 Aug 24 11:11:44.633848 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 287/547] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:44 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:45.201048 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:45.201662 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:45.208293 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:45.208774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:45.209202 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:45.209865 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:45.210958 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:45.211412 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:45.364761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:45.373930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:45.375436 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:45.376572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-88eb646e-fdbf-48ce-963a-c7f706f35694 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.179455 Aug 24 11:11:45.377100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 261/548] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:45 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:45.653592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:45.654848 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:45.661336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:45.661815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:45.662236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:45.663200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:45.663403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:45.663814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:45.822885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:45.832833 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e9f7d850-fea7-4081-839c-7cf6d78bf8b8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.182935 Aug 24 11:11:45.833889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 288/549] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:45 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:46.399911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:46.400539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:46.407514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:46.407997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:46.408430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:46.409271 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:46.409543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:46.409947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:46.545580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:46.556879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:46.559184 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:46.560914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1818a670-065d-4e8b-8b5d-40f787998085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.164765 Aug 24 11:11:46.561873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 262/550] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:46 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:11:46.861703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:46.862630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:46.870642 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:46.871138 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:46.871558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:46.872228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:46.872660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:46.873068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:47.011996 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:47.020222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9c004e91-c135-436e-aa8c-ae359fe0f1c8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.165074 Aug 24 11:11:47.020971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 289/551] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:46 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:47.584192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:47.584850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:47.592179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:47.592588 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:47.593146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:47.593694 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:47.594141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:47.594540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:47.730039 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:47.738910 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:47.740407 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:47.741690 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6b3520c1-49b9-42ac-a8db-591d0377eae2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.161430 Aug 24 11:11:47.742244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 263/552] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:47 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:48.042843 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:48.043542 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:48.050102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:48.050561 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:48.051338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:48.052760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:48.053627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:48.054108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:48.201163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:48.210849 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ecdd9a5c-0728-4dfe-a01e-f857538969f7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.173091 Aug 24 11:11:48.211444 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 290/553] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:48 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:48.765989 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:48.766586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:48.773819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:48.774290 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:48.774705 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:48.775405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:48.775829 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:48.776235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:48.911436 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:48.922858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:48.924368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:48.925536 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aa31cc91-5ee0-4cdc-b952-714e07746aa6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.163576 Aug 24 11:11:48.926077 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 264/554] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:48 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:49.232132 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:49.232732 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:49.238704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:49.239292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:49.239786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:49.240523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:49.240967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:49.241433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:49.374169 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:49.382729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a1cbe912-ff2e-458a-8326-c55f6aadb7a9 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.154275 Aug 24 11:11:49.383313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 291/555] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:49 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:49.954249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:49.955209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:49.963992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:49.964464 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:49.964878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:49.965554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:49.965988 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:49.966449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:50.112967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:50.127025 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:50.129480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:50.131121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9a04547b-f320-4af7-b809-8b4ceb11a5d9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.183808 Aug 24 11:11:50.132076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 265/556] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:49 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:50.409101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:50.409980 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:50.418048 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:50.418516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:50.418939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:50.419680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:50.420121 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:50.420538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:50.553632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:50.562448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f7252c2c-4065-4766-881c-0deb148b01a7 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1724 microversion: 2.1 time: 0.160414 Aug 24 11:11:50.563014 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 292/557] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:50 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:51.167351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:51.167935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:51.175011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.175516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.175944 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.176604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.177072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.177482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.333447 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:51.346496 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:51.348256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:51.349479 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-66bf2642-26df-4ee8-94f6-ce515ef7728c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.186649 Aug 24 11:11:51.350610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 266/558] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:51 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:51.583700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:51.584293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:51.590808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.591335 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.591758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.592471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.592933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.593611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.728814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:51.737574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c0a8b5a0-5aa8-47d9-84d7-c04b0e6f2eb2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1701 microversion: 2.1 time: 0.157756 Aug 24 11:11:51.738243 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 293/559] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:51 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:51.761357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-23cfe6f8-ce88-4677-acfc-db34219e0d0b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:51.767993 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23cfe6f8-ce88-4677-acfc-db34219e0d0b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.768475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23cfe6f8-ce88-4677-acfc-db34219e0d0b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.768900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-23cfe6f8-ce88-4677-acfc-db34219e0d0b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.794345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-23cfe6f8-ce88-4677-acfc-db34219e0d0b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Going to try to start instance {{(pid=120788) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:11:51.847645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-23cfe6f8-ce88-4677-acfc-db34219e0d0b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action" status: 202 len: 0 microversion: 2.1 time: 0.089373 Aug 24 11:11:51.849044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 267/560] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:11:51 2022] POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:11:51.859540 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:51.860234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:51.866139 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.866664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.867191 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:51.867950 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:51.868373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:51.868784 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:52.004484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:52.012868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8b791894-abd5-4ac5-a86e-7b0df025bfe1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1710 microversion: 2.1 time: 0.157158 Aug 24 11:11:52.013432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 294/561] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:51 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:52.352796 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1220713124", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "networks": [{"uuid": "fd33c4da-38ba-45dd-961d-689f940e1722"}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:11:52.376798 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:52.377391 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:52.385389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:52.385914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:52.386349 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:52.387029 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:52.387490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:52.387898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:52.415721 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] validate_networks() for [('fd33c4da-38ba-45dd-961d-689f940e1722', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:11:52.615883 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:52.625345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:52.626839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:52.628027 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-08ed71d0-ed88-40a3-a51e-af60ea3cd760 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.256401 Aug 24 11:11:52.628585 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 295/562] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:52 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:52.951087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:11:52.951600 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:11:52.952162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:11:52.952684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:11:52.953165 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:11:52.964353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:52.964809 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:52.965232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:52.966099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:52.966549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:52.966965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:52.994527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Getting quotas for project 2a55bdade09f4f7497c2978a440742b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:11:52.998656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Getting quotas for user f0c719b5b4a84bb89edd8d44a8d31e64 and project 2a55bdade09f4f7497c2978a440742b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:11:53.010344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:11:53.012707 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:11:53.034832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:53.035489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:53.042305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:53.042842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:53.043346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:53.044029 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:53.044471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:53.044898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:53.058373 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-59a9c2a6-cf37-4376-84f6-7836d235af88 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709860 Aug 24 11:11:53.059212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 268/563] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:11:53.070243 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f729ecf0-098f-4a01-8019-653581a3b833 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:53.070877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f729ecf0-098f-4a01-8019-653581a3b833 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:53.144212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f729ecf0-098f-4a01-8019-653581a3b833 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:53.152777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f729ecf0-098f-4a01-8019-653581a3b833 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1219 microversion: 2.1 time: 0.086411 Aug 24 11:11:53.153891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 269/564] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:53 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:53.211020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:53.219969 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9138e8c2-2f4e-4348-a559-a8a4cd4538ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1710 microversion: 2.1 time: 0.190016 Aug 24 11:11:53.220796 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 296/565] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:53 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1710 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:11:53.653070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:53.653691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:53.663465 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:53.664088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:53.664519 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:53.665201 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:53.665639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:53.666047 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:53.820062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:53.832413 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:53.834560 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:53.836200 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-342a816b-d40b-44f6-b94a-f3c316f4ff85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.188107 Aug 24 11:11:53.836723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 270/566] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:53 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:54.174334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:54.175033 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:54.181772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:54.182252 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:54.182680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:54.183405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:54.183849 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:54.184360 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:54.252232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:54.262806 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-87af1480-c149-49d4-8d72-f319e289ae43 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1223 microversion: 2.1 time: 0.092638 Aug 24 11:11:54.263419 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 297/567] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:54 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:54.417978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:54.418574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:54.425215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:54.425621 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:54.426044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:54.426726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:54.427210 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:54.427623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:54.575769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:54.586701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-657019fc-75be-478c-a10d-475223abaf08 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1710 microversion: 2.1 time: 0.348884 Aug 24 11:11:54.587466 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 271/568] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:54 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1710 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:54.859849 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:54.860505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:54.867154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:54.867633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:54.868077 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:54.869327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:54.869789 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:54.870208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.009948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:55.020628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:55.022339 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:55.023654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-514bb010-00b8-4465-96d7-dd4c25a4f3f6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.167483 Aug 24 11:11:55.024432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 298/569] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:54 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:55.286265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:55.286911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:55.297921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.298522 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.299076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.300104 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.300599 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.301020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.382480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:55.394722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c2de0f65-cb2c-4951-ad7b-2c321d8fc687 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1223 microversion: 2.1 time: 0.114380 Aug 24 11:11:55.395523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 272/570] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:55 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:55.608900 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:55.609537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:55.615828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.616321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.616750 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.617441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:55.617883 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:55.618293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:55.758494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:55.767041 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9ae7cf8b-ea39-413a-ba14-28b4bf1ae222 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1710 microversion: 2.1 time: 0.162225 Aug 24 11:11:55.767603 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 299/571] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:55 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:11:56.161490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:56.162130 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:56.168245 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.168705 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.169125 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:56.169801 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.170240 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.170651 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:56.303479 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:56.313169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:56.314660 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:56.315849 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f0bdedd4-43cf-4536-815a-7f1f353b8d2f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.268031 Aug 24 11:11:56.316406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 273/572] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:56 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:56.418058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:56.418649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:56.420511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=61 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:56.425829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.426273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.426708 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:56.427409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.427845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.428225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:56.500441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:56.508430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-85492c33-fa11-4f7f-8b9f-e27738766847 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1223 microversion: 2.1 time: 0.094485 Aug 24 11:11:56.509156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 300/573] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:56 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:56.794753 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:56.795368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:56.801949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.802357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.802779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:56.803486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:56.803927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:56.804343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:57.199269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:57.209424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-716a6a87-e989-43c3-9a1c-80fd561afefe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1710 microversion: 2.1 time: 0.421010 Aug 24 11:11:57.210007 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 274/574] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:56 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1710 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:57.339645 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:57.340431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:57.348195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:57.348675 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:57.349088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:57.349871 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:57.350306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:57.351099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:57.355494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:57.513009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:57.525297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:57.525297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:57.525297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e375118b-982f-4e7a-ba11-7f57fa6c883f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.189251 Aug 24 11:11:57.525694 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 301/575] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:57 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:57.531885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:57.532679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:57.542881 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:57.543491 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:57.543953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:57.545040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:57.545551 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:57.546070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:57.621473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:57.630011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-643a881e-1212-4e3d-b53d-f1b269b7988f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1223 microversion: 2.1 time: 0.104049 Aug 24 11:11:57.630591 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 275/576] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:57 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:11:58.236750 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:58.237365 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:58.243582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:58.244057 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:58.244472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:58.245312 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:58.245958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:58.246404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:58.386367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:58.395903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6e690f81-e059-4be7-9379-45a6197ef780 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1710 microversion: 2.1 time: 0.163427 Aug 24 11:11:58.396440 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 302/577] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:58 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:58.555260 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:58.555995 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:58.558893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:58.565099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:58.565619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:58.566111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:58.566975 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:58.567654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:58.568236 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:58.651641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:58.652293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:58.658717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:58.659224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:58.659645 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:58.660327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:58.660776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:58.661209 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:58.743442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:58.744147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:58.747974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:11:58.752354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9c78ba0d-cd08-4ead-aa4f-017a5c9fe7f9 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1271 microversion: 2.1 time: 0.105206 Aug 24 11:11:58.753080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 303/578] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:58 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:11:58.762230 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:58.763847 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:58.765274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-90a72134-1313-4ae8-9da8-8081fa700cbb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.215085 Aug 24 11:11:58.765938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 276/579] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:58 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:11:59.418449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:59.419069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:59.425709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.426502 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.427167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.428094 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.428880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.429534 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.576691 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:59.585775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7ee29060-2389-498f-8407-317ef55e1bdc tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1714 microversion: 2.1 time: 0.171699 Aug 24 11:11:59.586372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 304/580] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:59 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1714 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:59.773858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:59.774570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:59.781876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.782375 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.782802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.788280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:11:59.788869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:11:59.791850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.792357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.792780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.795504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.797691 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.798123 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.798831 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:11:59.799307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:11:59.799704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:11:59.889254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:59.899885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9d651d11-7139-46f5-ba92-8ae46cd63832 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1277 microversion: 2.1 time: 0.130090 Aug 24 11:11:59.900453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 277/581] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:11:59 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:11:59.959224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:59.967738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:59.969200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:11:59.970348 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f1405c04-d63c-4616-abb9-41214825de0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.185958 Aug 24 11:11:59.971100 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 305/582] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:11:59 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:12:00.925855 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:00.926837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:00.937075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:00.937549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:00.937964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:00.938642 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:00.939075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:00.939525 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:00.993467 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:00.994063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:01.000275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:01.000753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:01.001179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:01.001860 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:01.002325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:01.002783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:01.111598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:01.119683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8607f7bd-2031-442f-8cd3-3459618f852e tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.200361 Aug 24 11:12:01.120387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 278/583] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:00 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:01.157339 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:01.165948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:01.167464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:01.168621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b2779ec3-9b59-4f08-a93f-5763b9367c7d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.179106 Aug 24 11:12:01.169177 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 306/584] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:00 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:02.142533 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:02.143164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:02.150091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:02.150567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:02.150991 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:02.151720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:02.152145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:02.152554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:02.191536 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:02.192151 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:02.198305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:02.198784 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:02.199242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:02.199936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:02.200401 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:02.200817 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:02.337017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:02.345604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2f8797a5-282d-4db1-bcac-8521eb67ccd2 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.208159 Aug 24 11:12:02.346187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 279/585] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:02 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:02.364131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:02.372441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:02.373927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:02.375309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-519742b7-6281-4a01-8ef8-cc9637233503 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.187735 Aug 24 11:12:02.375858 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 307/586] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:02 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:03.365979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:03.366577 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:03.368610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:03.369746 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=8 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:03.375722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:03.376207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:03.376633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:03.377510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:03.377935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:03.378350 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:03.398975 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:03.399594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:03.405881 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:03.406715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:03.407242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:03.407896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:03.408546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:03.408952 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:03.590315 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:03.598429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a5137f96-fc2e-4a70-aac9-4d2d438556a1 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.236327 Aug 24 11:12:03.599505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 280/587] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:03 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:03.601602 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:03.604328 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-90112f38-c9ad-4d56-b47d-e3873ac61175 req-5b611eb1-cc8d-404c-9e58-da814917070e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "debfd4de-1266-4edf-bc64-2c0c584c6fb2", "tag": "57dccaf4-d4e7-49af-b259-22083a26bc75"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:03.613967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:03.614941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-90112f38-c9ad-4d56-b47d-e3873ac61175 req-5b611eb1-cc8d-404c-9e58-da814917070e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:03.615466 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:03.615885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-90112f38-c9ad-4d56-b47d-e3873ac61175 req-5b611eb1-cc8d-404c-9e58-da814917070e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:03.616770 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-aae48fc2-49ca-4869-8d3d-f2a2865f5841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.221692 Aug 24 11:12:03.616908 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-90112f38-c9ad-4d56-b47d-e3873ac61175 req-5b611eb1-cc8d-404c-9e58-da814917070e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:03.617314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 308/588] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:03 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:12:03.635103 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-90112f38-c9ad-4d56-b47d-e3873ac61175 req-5b611eb1-cc8d-404c-9e58-da814917070e service nova] Creating event network-changed:57dccaf4-d4e7-49af-b259-22083a26bc75 for instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 on hv-cinder-85427 Aug 24 11:12:03.640820 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-90112f38-c9ad-4d56-b47d-e3873ac61175 req-5b611eb1-cc8d-404c-9e58-da814917070e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039609 Aug 24 11:12:03.641334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 281/589] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:04.086660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-4960597c-8e69-4139-b245-0992fe9a88ed req-4833a1b5-b9a6-4a07-9ae1-24d8eff627e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7358f8-2cd1-41ac-a439-4630ad8630bc", "name": "network-vif-plugged", "status": "completed", "tag": "3265d28a-dfe5-435c-80d8-88ded1a20382"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:04.097720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-4960597c-8e69-4139-b245-0992fe9a88ed req-4833a1b5-b9a6-4a07-9ae1-24d8eff627e3 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:04.098387 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-4960597c-8e69-4139-b245-0992fe9a88ed req-4833a1b5-b9a6-4a07-9ae1-24d8eff627e3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:04.098815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-4960597c-8e69-4139-b245-0992fe9a88ed req-4833a1b5-b9a6-4a07-9ae1-24d8eff627e3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:04.112135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-4960597c-8e69-4139-b245-0992fe9a88ed req-4833a1b5-b9a6-4a07-9ae1-24d8eff627e3 service nova] Creating event network-vif-plugged:3265d28a-dfe5-435c-80d8-88ded1a20382 for instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc on hv-cinder-85427 Aug 24 11:12:04.117958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-4960597c-8e69-4139-b245-0992fe9a88ed req-4833a1b5-b9a6-4a07-9ae1-24d8eff627e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034929 Aug 24 11:12:04.118601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 309/590] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:04.623913 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:04.624856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:04.631898 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:04.632368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:04.632823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:04.633498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:04.633942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:04.634465 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:04.640108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:04.640838 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:04.647243 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:04.647747 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:04.648165 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:04.648837 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:04.649275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:04.649682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:04.839228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:04.847920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:04.848180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1d752e1b-bf52-4168-a043-8efc8a58fc7d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.230847 Aug 24 11:12:04.848951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 282/591] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:04 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:04.856504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:04.857988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:04.859804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0746de0c-27f4-487f-9def-3a0881e8aae8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.223351 Aug 24 11:12:04.860363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 310/592] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:04 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:05.870433 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:05.871643 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:05.881504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:05.881982 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:05.882408 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:05.883151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:05.883593 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:05.883947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:05.884407 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:05.884519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:05.890733 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:05.891512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:05.891918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:05.892628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:05.893068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:05.893478 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:06.081043 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:06.088000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:06.088675 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-45f10aa0-7572-414d-a9da-f753ccb03de3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.223608 Aug 24 11:12:06.089214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 283/593] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:05 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:12:06.096705 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:06.098193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:06.099379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-48d498af-7535-4213-ba2d-7982cf64116f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.220150 Aug 24 11:12:06.099960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 311/594] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:05 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:07.114841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:07.117240 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:07.125680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:07.126283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:07.129572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:07.130440 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:07.131372 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:07.132445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:07.132557 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:07.132941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:07.133364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:07.133504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:07.134044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:07.134179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:07.134487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:07.134888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:07.328956 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:07.336949 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b2651103-5628-483c-a09d-d13b01588c42 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.230543 Aug 24 11:12:07.337513 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 284/595] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:07 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:07.338119 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:07.347441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:07.348930 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:07.350150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-97e663f1-6002-420a-97ee-37d4929de953 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.230755 Aug 24 11:12:07.350690 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 312/596] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:07 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:08.357936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:08.358732 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:08.366124 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:08.366633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:08.367089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:08.367857 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:08.368328 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:08.368751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:08.374142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:08.375482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:08.381566 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:08.382040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:08.382467 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:08.383181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:08.383630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:08.384044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:08.564725 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:08.571758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:08.572663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-148a07dd-2f89-4979-b934-520bb2d33523 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.218828 Aug 24 11:12:08.573230 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 285/597] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:08 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:08.580594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:08.582057 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:08.583207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c461bd8c-59a0-451f-826e-659cdf2523ec tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.213222 Aug 24 11:12:08.583766 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 313/598] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:08 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:09.593031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:09.593821 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:09.600958 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:09.601444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:09.601873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:09.602556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:09.603005 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:09.603452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:09.609011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:09.609554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:09.615828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:09.616307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:09.616732 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:09.617412 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:09.617850 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:09.618264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:09.788992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:09.796926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4af86d6b-1819-46b6-96cf-843225352033 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.207884 Aug 24 11:12:09.797487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 286/599] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:09 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:09.813392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:09.825787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:09.827425 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:09.828586 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ad7f98f6-ae9c-4dc5-b6cc-34abb32bce66 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.223608 Aug 24 11:12:09.829173 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 314/600] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:09 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:10.819815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:10.820618 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:10.830133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:10.830852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:10.831460 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:10.832371 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:10.833004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:10.833575 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:10.853193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:10.853759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:10.859967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:10.860441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:10.860867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:10.861546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:10.861989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:10.862397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:11.041516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:11.049171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:11.050096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f4ef8fc0-ebdf-4efb-864c-1999e835594d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.235724 Aug 24 11:12:11.050706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 287/601] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:10 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:11.057464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:11.058990 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:11.060154 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d6ea4cee-d190-4eb7-bb18-8833ecb390d8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.210929 Aug 24 11:12:11.060661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 315/602] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:10 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:12.070744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:12.071408 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:12.078509 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:12.078976 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:12.079423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:12.080094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:12.080531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:12.080921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:12.088640 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:12.089237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:12.095641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:12.096173 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:12.096637 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:12.097323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:12.097923 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:12.098346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:12.278096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:12.282937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:12.286269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5cacbd73-6de3-467a-90b9-cdde690cf912 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.219485 Aug 24 11:12:12.286809 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 288/603] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:12 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:12.291379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:12.292880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:12.294031 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-09848966-1a5f-414a-af4a-353423df705c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.209383 Aug 24 11:12:12.294607 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 316/604] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:12 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:13.307974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:13.308578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:13.315571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:13.316135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:13.316586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:13.317277 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:13.317710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:13.318353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:13.324808 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:13.325544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:13.332122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:13.332604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:13.333260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:13.337280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:13.337280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:13.337280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:13.540797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:13.545150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:13.549903 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e06b06c6-74e9-4bac-9632-d5fa71204ebe tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.246303 Aug 24 11:12:13.550506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 289/605] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:13 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:13.566626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:13.568186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:13.569461 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7c977504-b300-4c0e-902b-8b9d2031e690 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.250766 Aug 24 11:12:13.569991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 317/606] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:13 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:14.574426 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:14.575386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:14.583322 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.583798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.584257 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.584941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.585380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.585795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.592443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:14.593027 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:14.599237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.599716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.600136 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.600835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:14.601262 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:14.601672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:14.619925 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=100 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:14.776570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:14.785705 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6e0c7c39-bdc4-4897-b5b3-6fa13ed02107 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.217070 Aug 24 11:12:14.786270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 290/607] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:14 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:14.799411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:14.812646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:14.814197 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:14.815355 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4b4ae2bf-ca16-45d2-a128-2f1031ed751e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1744 microversion: 2.20 time: 0.226754 Aug 24 11:12:14.815904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 318/608] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:14 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:15.807365 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:15.808826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:15.815810 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.816562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.817142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.817993 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.818587 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.819319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.840403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:15.842072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:15.852787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.857412 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.857855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:15.858556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:15.859039 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:15.859589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:16.077125 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:16.085411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b75b02fe-ec02-4ca3-ac12-7357f6d3f77d tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.282488 Aug 24 11:12:16.086297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 291/609] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:15 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:16.183987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:16.203299 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:16.204911 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:16.206077 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9a38db87-3bbc-4dbb-8058-7f3bd52cc4fb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.372216 Aug 24 11:12:16.206630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 319/610] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:15 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:17.109956 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:17.110593 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:17.124132 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.126439 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.127632 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.129820 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.131589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.132887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.229140 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:17.229751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:17.238389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.238867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.239675 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.246384 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.247178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.247836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.334843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:17.359915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9660732e-8b39-47d5-84b6-739084e35950 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.257546 Aug 24 11:12:17.360574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 292/611] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:17 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:17.465590 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:17.474658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:17.476411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:17.477727 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6ac47f61-5b8e-454d-9ffe-4cb9c251296e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.252421 Aug 24 11:12:17.478278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 320/612] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:17 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:17.705105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-2291cf47-75d5-4d50-ae13-b7672e4724d0 req-9b965620-6b8e-4220-af11-3e119f8ee57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debfd4de-1266-4edf-bc64-2c0c584c6fb2", "name": "network-vif-plugged", "status": "completed", "tag": "57dccaf4-d4e7-49af-b259-22083a26bc75"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:17.720428 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2291cf47-75d5-4d50-ae13-b7672e4724d0 req-9b965620-6b8e-4220-af11-3e119f8ee57f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:17.721267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2291cf47-75d5-4d50-ae13-b7672e4724d0 req-9b965620-6b8e-4220-af11-3e119f8ee57f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:17.721927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-2291cf47-75d5-4d50-ae13-b7672e4724d0 req-9b965620-6b8e-4220-af11-3e119f8ee57f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:17.737610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-2291cf47-75d5-4d50-ae13-b7672e4724d0 req-9b965620-6b8e-4220-af11-3e119f8ee57f service nova] Creating event network-vif-plugged:57dccaf4-d4e7-49af-b259-22083a26bc75 for instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 on hv-cinder-85427 Aug 24 11:12:17.742947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-2291cf47-75d5-4d50-ae13-b7672e4724d0 req-9b965620-6b8e-4220-af11-3e119f8ee57f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042390 Aug 24 11:12:17.743639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 293/613] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:18.383476 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:18.384080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:18.391784 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:18.392270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:18.392713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:18.393430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:18.393859 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:18.394267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:18.506795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:18.508141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:18.519628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:18.520396 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:18.520978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:18.523642 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:18.524733 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:18.525843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:18.624970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:18.633128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1f30af97-9a18-4707-8172-c1e6aaee2c13 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.253388 Aug 24 11:12:18.633696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 321/614] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:18 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:18.693356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:18.697359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=100 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:18.704309 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:18.706121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:18.707541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ba200300-8b7d-4494-8a69-acb9368dc33b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.205572 Aug 24 11:12:18.708259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 294/615] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:18 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:19.653751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:19.654348 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:19.661665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:19.662597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:19.663158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:19.664096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:19.664693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:19.665374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:19.734914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:19.735665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:19.743343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:19.744173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:19.744670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:19.745433 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:19.745948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:19.746447 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:19.893022 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:19.904538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-41a6a954-238e-43fb-89ad-adabca14d393 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1319 microversion: 2.1 time: 0.254227 Aug 24 11:12:19.920115 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 322/616] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:19 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:19.952383 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:19.961523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:19.963017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:19.964420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-83a8ad54-c6a7-4b38-ae64-4e5b81007083 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.233645 Aug 24 11:12:19.965142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 295/617] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:19 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:12:20.927127 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:20.928079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:20.935105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:20.935606 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:20.936025 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:20.936972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:20.937595 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:20.938110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:20.989914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:20.991241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:20.998267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:20.998846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:20.999360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:21.001132 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:21.001583 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:21.001969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:21.141834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:21.151004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-eba0a266-d646-41a6-b500-599fc0f18df3 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1508 microversion: 2.1 time: 0.228795 Aug 24 11:12:21.151614 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 323/618] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:12:20 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:12:21.172480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:21.172711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d66bcd9-caf8-40c2-9c17-17d0b55ff64b", "device": "/dev/sdb"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:21.175911 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:21.181748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:21.181939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:21.182390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:21.182813 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:21.183309 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:21.183537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:21.184118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:21.184506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b89c67f8-175d-4707-959c-baf1c0359841 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.198467 Aug 24 11:12:21.184632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:21.185052 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 296/619] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:20 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:21.505298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cfebb2ac-d094-4c0b-8c11-479bfd1d71e6 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "POST /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335783 Aug 24 11:12:21.507195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 324/620] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:12:21 2022] POST /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:22.208400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:22.209735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:22.216838 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:22.217624 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:22.218359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:22.219330 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:22.220017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:22.220500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:22.357045 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:22.366562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:22.368082 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:22.369486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cad3b934-1ece-43d1-8090-3d180893b2d1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.165025 Aug 24 11:12:22.370011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 297/621] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:22 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:23.395268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:23.396747 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:23.403953 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:23.404699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:23.405421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:23.406863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:23.407450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:23.407877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:23.550846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:23.559755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:23.561471 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:23.562702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4e290bb3-81a6-4acb-8366-82cbe55c3752 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.172404 Aug 24 11:12:23.563284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 325/622] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:23 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:24.586416 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:24.587299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:24.594696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:24.595310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:24.595811 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:24.596614 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:24.597134 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:24.597619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:24.794841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:24.804503 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:24.806299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:24.807647 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f008ac11-ab7c-4801-9ec4-e9acd68ce8c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.225432 Aug 24 11:12:24.808298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 298/623] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:24 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:25.832328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:25.833058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:25.840380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:25.840878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:25.841331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:25.842298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:25.842719 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:25.843175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:25.981556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:25.995244 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:25.997563 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:25.999221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b0118ee5-ebaf-4641-afa7-803ec707abaa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1739 microversion: 2.20 time: 0.171832 Aug 24 11:12:25.999862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 326/624] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:25 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:27.025929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:27.026836 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:27.035308 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:27.035783 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:27.036208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:27.036890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:27.037334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:27.037748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:27.180067 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:27.188673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:27.190341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:27.191580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-579392c2-4a4a-4db8-aff3-24d9da65ff3b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1721 microversion: 2.20 time: 0.172259 Aug 24 11:12:27.192205 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 299/625] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:27 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:28.214713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:28.215344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:28.217832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=54 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:28.223678 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:28.224142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:28.224569 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:28.225244 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:28.225681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:28.226096 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:28.361771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:28.370507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:28.372013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:28.373156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2710469c-9699-495f-b194-982e66f20c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1721 microversion: 2.20 time: 0.162489 Aug 24 11:12:28.373858 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 327/626] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:28 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:29.396402 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:29.397021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:29.399360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=48 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:29.404799 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:29.405253 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:29.406049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:29.406843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:29.407310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:29.407716 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:29.564971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:29.576567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:29.578140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:29.579287 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a893a9a1-9461-47d2-ad22-d54f04421027 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1721 microversion: 2.20 time: 0.186919 Aug 24 11:12:29.579901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 300/627] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:29 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:29.699350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-7a8fc43c-8b99-47d3-9e03-d67fdbbd2247 req-e15e77c3-d1fb-4453-9813-c4bba8991daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7358f8-2cd1-41ac-a439-4630ad8630bc", "name": "network-vif-unplugged", "status": "completed", "tag": "3265d28a-dfe5-435c-80d8-88ded1a20382"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:29.710296 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-7a8fc43c-8b99-47d3-9e03-d67fdbbd2247 req-e15e77c3-d1fb-4453-9813-c4bba8991daa service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:29.710787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-7a8fc43c-8b99-47d3-9e03-d67fdbbd2247 req-e15e77c3-d1fb-4453-9813-c4bba8991daa service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:29.711276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-7a8fc43c-8b99-47d3-9e03-d67fdbbd2247 req-e15e77c3-d1fb-4453-9813-c4bba8991daa service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:29.724346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-7a8fc43c-8b99-47d3-9e03-d67fdbbd2247 req-e15e77c3-d1fb-4453-9813-c4bba8991daa service nova] Creating event network-vif-unplugged:3265d28a-dfe5-435c-80d8-88ded1a20382 for instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc on hv-cinder-85427 Aug 24 11:12:29.729553 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-7a8fc43c-8b99-47d3-9e03-d67fdbbd2247 req-e15e77c3-d1fb-4453-9813-c4bba8991daa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033977 Aug 24 11:12:29.730144 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 328/628] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:12:30.602836 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:30.603406 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:30.610136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:30.610609 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:30.611025 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:30.611728 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:30.612169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:30.612583 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:30.746700 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:30.756795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:30.758276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:30.759456 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f66b78c1-4c0b-4b98-af6a-87116dfbc915 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1724 microversion: 2.20 time: 0.160530 Aug 24 11:12:30.760039 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 301/629] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:30 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:30.784855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b309fe5-140e-4a1b-a5a0-b857d4e59d97"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:30.787426 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:30.793996 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:30.794490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:30.794909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:30.795604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:30.796382 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:30.796857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:31.109532 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-42400416-4b60-43f0-9f45-ecad0330b399 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329418 Aug 24 11:12:31.110202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 329/630] 10.222.0.79 () {62 vars in 1364 bytes} [Wed Aug 24 11:12:30 2022] POST /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:12:31.242265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:12:31.242861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:31.249455 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:31.250084 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:31.250429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:31.251306 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:31.251747 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:31.252158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:31.295934 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120788) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:12:31.379539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-585c09ac-bcb1-4f19-8b1f-586832b41a6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/action" status: 202 len: 0 microversion: 2.20 time: 0.141036 Aug 24 11:12:31.380362 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 302/631] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 24 11:12:31 2022] POST /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:12:31.388629 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:31.389230 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:31.395493 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:31.395973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:31.396403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:31.397094 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:31.397770 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:31.398482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:31.534011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:31.543445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:31.545102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:31.546366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-18353b25-efcb-4c35-a6f7-80c73b33251e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1750 microversion: 2.20 time: 0.161770 Aug 24 11:12:31.546975 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 330/632] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:31 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:32.569245 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:32.569852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:32.576711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:32.577242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:32.577853 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:32.578611 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:32.579076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:32.579506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:32.718959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:32.727761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:32.729242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:32.730369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5d9ec367-43db-4c25-82c7-cb962ee3dfbd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1750 microversion: 2.20 time: 0.165169 Aug 24 11:12:32.730922 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 303/633] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:32 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:33.755677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:33.756304 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:33.764490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:33.765022 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:33.765492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:33.766314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:33.766938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:33.767450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:33.910677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:33.914216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:33.920354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:33.921810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:33.922999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3dd0c5cb-6a26-4ce5-9a54-33ef23a0db79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1750 microversion: 2.20 time: 0.172295 Aug 24 11:12:33.923604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 331/634] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:33 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:34.946265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:34.946876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:34.953895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:34.954363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:34.954786 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:34.955506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:34.955948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:34.956353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:35.109987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:35.118592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:35.120179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:35.121316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-37a85754-c685-4aa7-84c0-25ec99fa9711 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1750 microversion: 2.20 time: 0.179032 Aug 24 11:12:35.121872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 304/635] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:34 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:36.147560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:36.148160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:36.155854 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:36.156334 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:36.156759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:36.157449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:36.157891 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:36.158305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:36.303703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:36.316703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:36.318435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:36.319611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0b94eee6-bdb1-4964-a661-47203464baf3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1752 microversion: 2.20 time: 0.178612 Aug 24 11:12:36.320133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 332/636] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:36 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:37.345629 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:37.346334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:37.354368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:37.354858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:37.355439 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:37.356147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:37.356585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:37.357001 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:37.519094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:37.529634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:37.531137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:37.532320 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9c3efc86-ee67-4853-b43b-bd26eb80f929 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1752 microversion: 2.20 time: 0.193010 Aug 24 11:12:37.532918 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 305/637] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:37 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:38.556020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:38.556678 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:38.570247 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:38.570759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:38.571250 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:38.571920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:38.572309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:38.572725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:38.708423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:38.718042 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:38.719682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:38.720922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-daeabc3e-21a8-465e-b9e6-56c7c8c60837 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.168799 Aug 24 11:12:38.722293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 333/638] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:38 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:39.745041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:39.745696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:39.753237 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:39.753969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:39.754451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:39.755185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:39.755716 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:39.756140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:39.923262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:39.932887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:39.934768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:39.936191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-657325ae-5abc-4645-8d3f-95a5d6b66807 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.195261 Aug 24 11:12:39.951318 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 306/639] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:39 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:40.964267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:40.965079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:40.975114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:40.975741 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:40.976252 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:40.977237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:40.978222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:40.978559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:41.116340 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:41.126204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:41.127753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:41.128950 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6aa80e36-39f8-4d44-aeba-541bc2703609 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.171646 Aug 24 11:12:41.129501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 334/640] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:40 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:42.153252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:42.154907 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:42.163071 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:42.163703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:42.164190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:42.165505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:42.166685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:42.167124 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:42.311400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:42.320159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:42.322547 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:42.323904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0d4b57f2-1c3f-4c0a-8b4d-92903278fa55 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.175634 Aug 24 11:12:42.324476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 307/641] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:42 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:43.347846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:43.348464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:43.355959 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:43.356729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:43.357156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:43.357862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:43.358308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:43.358727 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:43.504943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:43.522219 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:43.523769 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:43.524951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0feb1e35-55ed-47a7-b7e8-a30f09410889 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.181017 Aug 24 11:12:43.525505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 335/642] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:43 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:44.548105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:44.549816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:44.556729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:44.557396 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:44.558216 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:44.558474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:44.558944 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:44.559492 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:44.699265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:44.708494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:44.709946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:44.711152 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-70954648-c884-42d7-9054-f75f922d5373 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.167053 Aug 24 11:12:44.711804 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 308/643] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:44 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:45.739885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:45.740767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:45.749166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:45.749649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:45.750073 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:45.750755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:45.751242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:45.751659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:45.890906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:45.899560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:45.901182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:45.902342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cf27a119-6cdd-4e06-8345-6b237c191003 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.169335 Aug 24 11:12:45.902896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 336/644] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:45 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:46.930133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:46.931323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:46.942564 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:46.943419 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:46.944148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:46.945272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:46.946033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:46.946713 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:47.092373 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:47.101002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:47.102465 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:47.103636 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7447207b-da0e-4db8-b0c5-8f183e91b415 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.180023 Aug 24 11:12:47.104183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 309/645] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:46 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:48.129312 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:48.130227 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:48.139886 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:48.140422 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:48.140847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:48.141548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:48.141993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:48.142405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:48.281842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:48.296542 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:48.298014 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:48.299247 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-78199f32-0467-41d0-9566-782f336029d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.176028 Aug 24 11:12:48.299853 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 337/646] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:48 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:49.329737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:49.331478 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:49.340283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:49.341281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:49.341739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:49.343163 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:49.343619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:49.344038 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:49.346971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:49.492953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:49.502233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:49.503754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:49.504892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e8e339dd-f9c1-45ef-9c4b-9e101495754c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.180952 Aug 24 11:12:49.505443 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 310/647] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:49 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:50.530210 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:50.530862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:50.538081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:50.538582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:50.539027 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:50.539771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:50.540239 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:50.540672 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:50.682135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:50.693291 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:50.694790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:50.695999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8d3d04df-4a61-48cb-95d2-b146eca47aa7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.170371 Aug 24 11:12:50.696903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 338/648] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:50 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:51.720652 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:51.721316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:51.727616 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:51.728057 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:51.728484 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:51.729159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:51.729602 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:51.730012 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:51.884089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:51.889323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:51.890875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:51.892063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4b323a38-faab-4151-9910-30d733712f28 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.176094 Aug 24 11:12:51.892621 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 311/649] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:51 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:52.449110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:52.449734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:52.457157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:52.457655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:52.458070 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:52.458765 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:52.459266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:52.459834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:52.540401 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lazy-loading 'services' on Instance uuid debfd4de-1266-4edf-bc64-2c0c584c6fb2 {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:12:52.617753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-01cb509d-3e9b-44d2-b90d-beacc102897c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2/os-volume_attachments/6d66bcd9-caf8-40c2-9c17-17d0b55ff64b" status: 202 len: 0 microversion: 2.1 time: 0.175851 Aug 24 11:12:52.618453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 339/650] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:12:52 2022] DELETE /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2/os-volume_attachments/6d66bcd9-caf8-40c2-9c17-17d0b55ff64b => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:12:52.915789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:52.916535 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:52.923590 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:52.924063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:52.924483 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:52.925174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:52.925639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:52.926044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:53.067889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:53.076834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:53.078309 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:53.079606 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4c57df37-97ab-4ba5-9d47-730a9beef049 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.167739 Aug 24 11:12:53.080252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 312/651] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:52 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:54.109643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:54.111890 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:54.119793 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:54.120469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:54.121047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:54.121996 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:54.122583 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:54.123208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:54.266170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:54.275389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:54.277263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:54.278676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4e0d6a02-8def-4646-8399-0ae24f07c812 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.177074 Aug 24 11:12:54.294068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 340/652] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:54 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:55.303483 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:55.304239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:55.312498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:55.313091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:55.313624 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:55.314457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:55.315241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:55.315864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:55.457104 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:55.465846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:55.467348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:55.468502 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-05f9f7d1-fd86-46e2-871a-cb15f0379d5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.169942 Aug 24 11:12:55.469060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 313/653] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:55 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:56.496363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:56.497218 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:56.508214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:56.509007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:56.509787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:56.510988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:56.514875 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:56.515941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:56.661170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:56.669983 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:56.671621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:56.672771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-65dd360d-20af-4a12-9e14-2e558ab13a31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.183316 Aug 24 11:12:56.673322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 341/654] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:56 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:57.698617 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:57.699451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:57.708777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:57.709426 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:57.709996 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:57.710906 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:57.711584 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:57.712141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:57.863747 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:57.872943 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:57.874458 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:57.875845 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3ccbac7a-a2f9-41dd-a0e4-9610b8f4eee7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.182660 Aug 24 11:12:57.876400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 314/655] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:57 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:12:58.899987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:12:58.900627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:12:58.903864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=30 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:12:58.911036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:58.911866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:58.912303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:58.913007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:12:58.913458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:12:58.914234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:12:59.067633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:59.090331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:59.091898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:12:59.094664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-77583b05-a1f7-4db4-8329-c51ea06cae6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.198768 Aug 24 11:12:59.095736 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 342/656] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:12:58 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:00.118989 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:00.119569 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:00.121914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:00.127393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:00.127883 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:00.128312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:00.128984 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:00.129422 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:00.129827 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:00.156684 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:00.157248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:00.164326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:00.164812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:00.165237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:00.165924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:00.166372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:00.166783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:00.200785 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:13:00.280229 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d479f6d9-072f-4f28-a1c9-69e698c9eaba tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "DELETE /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 204 len: 0 microversion: 2.1 time: 0.127151 Aug 24 11:13:00.280826 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 343/657] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:13:00 2022] DELETE /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:13:00.281177 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:00.290234 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:00.290522 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:00.290908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:00.291987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:00.293112 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a932452b-ef42-4732-9da6-0f6813e73c31 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.178064 Aug 24 11:13:00.293918 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 315/658] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:00 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:00.298292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:00.298787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:00.299243 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:00.300802 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:00.301266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:00.301682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:00.438521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:00.448813 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-88124d81-a55c-4277-b221-7b6538635862 tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1514 microversion: 2.1 time: 0.162843 Aug 24 11:13:00.449394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 344/659] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:00 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:01.320157 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:01.320853 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:01.327812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:01.328299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:01.328727 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:01.329423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:01.330044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:01.330275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:01.468748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:01.469717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:01.470319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:01.477249 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:01.477694 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:01.478112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:01.478596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:01.478839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:01.479317 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:01.479731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:01.480185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:01.481428 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7d4e7357-8c3b-4945-878f-9aa3c5494d8a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.167342 Aug 24 11:13:01.481953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 316/660] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:01 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:01.633278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:01.645202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f5cc14b9-45f6-41e9-9282-967f1c1bd19c tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1514 microversion: 2.1 time: 0.179002 Aug 24 11:13:01.646045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 345/661] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:01 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:13:02.505121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:02.505725 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:02.513060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.513582 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.514000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.514676 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.515128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.515558 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.656246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:02.666122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:02.666727 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:02.667278 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:02.668998 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:02.670547 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5ec8f8e2-901a-47e1-a863-072c1c9e6f00 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.169485 Aug 24 11:13:02.673556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.673927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 317/662] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:02 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:02.674433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.675083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.675940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.676551 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.677168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.693894 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:02.752759 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-25f43132-7e1b-4bb5-a8a0-ec702d3997b3 req-4394e325-f479-467d-8209-98bc295fe7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "debfd4de-1266-4edf-bc64-2c0c584c6fb2", "name": "network-vif-deleted", "tag": "57dccaf4-d4e7-49af-b259-22083a26bc75"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:02.757460 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c719b5b4a84bb89edd8d44a8d31e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a55bdade09f4f7497c2978a440742b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:02.762472 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-25f43132-7e1b-4bb5-a8a0-ec702d3997b3 req-4394e325-f479-467d-8209-98bc295fe7de service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:02.762947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-25f43132-7e1b-4bb5-a8a0-ec702d3997b3 req-4394e325-f479-467d-8209-98bc295fe7de service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:02.763388 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-25f43132-7e1b-4bb5-a8a0-ec702d3997b3 req-4394e325-f479-467d-8209-98bc295fe7de service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:02.765189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-199a6b81-2b49-4691-bdb8-cb6c0fb124dc tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 200 len: 1472 microversion: 2.1 time: 0.102949 Aug 24 11:13:02.771338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 346/663] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:02 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 1472 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:13:02.774750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-25f43132-7e1b-4bb5-a8a0-ec702d3997b3 req-4394e325-f479-467d-8209-98bc295fe7de service nova] Creating event network-vif-deleted:57dccaf4-d4e7-49af-b259-22083a26bc75 for instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 on hv-cinder-85427 Aug 24 11:13:02.779986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-25f43132-7e1b-4bb5-a8a0-ec702d3997b3 req-4394e325-f479-467d-8209-98bc295fe7de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104523 Aug 24 11:13:02.780742 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 318/664] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:13:03.695180 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:03.695811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.703353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.703996 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.704475 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.705229 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.705722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.706182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.787989 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:03.789775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] [instance: debfd4de-1266-4edf-bc64-2c0c584c6fb2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:03.798366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.798858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.799309 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.800042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:03.800515 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:03.800928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:03.817516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] HTTP exception thrown: Instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 could not be found. Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Request method failure captured: Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 HTTP/1.1 Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgcH9oekNPZWqT2LZWG-jchg4qlmC2vBHmgPsLRSJRZaNYQFCxrZDRIEfF89VkPt3RWaGSJsAT8JyidA30pdook_Sog4x2IRz6Ym4wueLsnIOO68WAYixZ-gcBJOaFuryC9-U3GF9y97Dj4TTj9SKWlmBToBugVCJw4v2PeZWzjNZ5w Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 2a55bdade09f4f7497c2978a440742b8 Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesSnapshotTestJSON-364052716 Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:13:03.819244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a55bdade09f4f7497c2978a440742b8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a55bdade09f4f7497c2978a440742b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a55bdade09f4f7497c2978a440742b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a55bdade09f4f7497c2978a440742b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesSnapshotTestJSON-364052716 Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 2a55bdade09f4f7497c2978a440742b8 Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-364052716 Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesSnapshotTestJSON-364052716-project Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: f0c719b5b4a84bb89edd8d44a8d31e64 Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesSnapshotTestJSON-364052716-project Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 could not be found. Aug 24 11:13:03.820870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'debfd4de-1266-4edf-bc64-2c0c584c6fb2'} Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 could not be found. Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:13:03.821724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 could not be found. Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 could not be found. Aug 24 11:13:03.823034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:13:03.824423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] Returning 404 to user: Instance debfd4de-1266-4edf-bc64-2c0c584c6fb2 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:13:03.824423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a4b04ba2-f5c0-4984-b98f-e562f3ea8f2f tempest-VolumesSnapshotTestJSON-364052716 tempest-VolumesSnapshotTestJSON-364052716-project] 10.222.0.79 "GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2" status: 404 len: 111 microversion: 2.1 time: 0.038100 Aug 24 11:13:03.824423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 319/665] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:03 2022] GET /compute/v2.1/servers/debfd4de-1266-4edf-bc64-2c0c584c6fb2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:13:03.843420 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:03.853341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:03.854841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:03.856019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-bc0ec72b-e298-44e3-b3d0-afcb89ec3a94 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.165612 Aug 24 11:13:03.856934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 347/666] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:03 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:04.882548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:04.883630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:04.890194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.890667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.891089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:04.891797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:04.892237 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:04.892649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:05.025275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:05.034725 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:05.036253 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:05.037416 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13313cd8-e4b2-4e03-81ff-4a9864e57b11 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.161237 Aug 24 11:13:05.038109 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 320/667] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:04 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:06.061952 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:06.062617 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:06.070947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:06.071537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:06.072042 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:06.072842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:06.073361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:06.073849 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:06.429906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:06.439212 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:06.440731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:06.441885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-19480a29-cf6b-4a82-9b50-e9dcaa568862 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.384608 Aug 24 11:13:06.442441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 348/668] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:06 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:07.473441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:07.474135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:07.480850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:07.481323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:07.481731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:07.482417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:07.482947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:07.483414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:07.614553 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:07.623748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:07.625238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:07.626393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2cce60ca-6e99-4241-9b4b-47a9484d9f0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.157050 Aug 24 11:13:07.626941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 321/669] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:07 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:08.649589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:08.650159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:08.657866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:08.658277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:08.658704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:08.659464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:08.659916 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:08.660326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:08.796107 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:08.804819 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:08.806298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:08.807478 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-75742426-fd6a-44f7-a112-7b6bb218ac5c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.161930 Aug 24 11:13:08.808036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 349/670] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:08 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:09.834677 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:09.835599 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:09.843094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:09.843628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:09.844070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:09.844775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:09.845232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:09.845656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:09.979223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:09.988428 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:09.989909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:09.991088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6a02624a-3ed4-4f52-ba3e-79677f5d47e7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.162886 Aug 24 11:13:09.991675 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 322/671] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:09 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:11.020429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:11.021288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:11.032747 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:11.033537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:11.034320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:11.035510 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:11.036212 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:11.036902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:11.183596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:11.196585 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:11.198958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:11.200763 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-52e96ef6-7b99-47e4-ae21-1e4bf8389fd0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.186912 Aug 24 11:13:11.201624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 350/672] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:11 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:12.230059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:12.230637 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:12.240549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:12.241247 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:12.241711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:12.242478 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:12.243069 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:12.243539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:12.378706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:12.388021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:12.389377 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:12.390569 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9df4b488-7bb9-4c7b-889a-9428f4713327 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.167104 Aug 24 11:13:12.391121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 323/673] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:12 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:12.488412 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-f09cca64-d0a7-405a-a332-06bf35572fd0 req-3a2549e9-99b3-4d26-a8e0-a9a248dfa24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7358f8-2cd1-41ac-a439-4630ad8630bc", "name": "network-vif-plugged", "status": "completed", "tag": "3265d28a-dfe5-435c-80d8-88ded1a20382"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:12.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f09cca64-d0a7-405a-a332-06bf35572fd0 req-3a2549e9-99b3-4d26-a8e0-a9a248dfa24b service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:12.499093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f09cca64-d0a7-405a-a332-06bf35572fd0 req-3a2549e9-99b3-4d26-a8e0-a9a248dfa24b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:12.499515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f09cca64-d0a7-405a-a332-06bf35572fd0 req-3a2549e9-99b3-4d26-a8e0-a9a248dfa24b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:12.511079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-f09cca64-d0a7-405a-a332-06bf35572fd0 req-3a2549e9-99b3-4d26-a8e0-a9a248dfa24b service nova] Creating event network-vif-plugged:3265d28a-dfe5-435c-80d8-88ded1a20382 for instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc on hv-cinder-85427 Aug 24 11:13:12.516389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-f09cca64-d0a7-405a-a332-06bf35572fd0 req-3a2549e9-99b3-4d26-a8e0-a9a248dfa24b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096170 Aug 24 11:13:12.516936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 351/674] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:13:13.413580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:13.414148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:13.421288 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:13.421771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:13.422206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:13.422876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:13.423349 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:13.423761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:13.562505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:13.575394 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:13.577530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:13.579030 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f890e595-39ad-4392-a263-c14fd671c1c9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.169356 Aug 24 11:13:13.579820 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 324/675] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:13 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:14.604020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:14.604722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:14.614146 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:14.615006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:14.615827 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:14.617578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:14.618087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:14.618853 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:14.762538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:14.776040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:14.778544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:14.780207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-97d8fdd5-f3ac-4f95-8dde-217c7501c200 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.181108 Aug 24 11:13:14.780865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 352/676] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:14 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:15.808980 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:15.810389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:15.817571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:15.818094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:15.818578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:15.819356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:15.819888 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:15.820308 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:15.958377 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:15.970773 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:15.973172 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:15.974938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2cd2abdc-afa2-48c0-9527-384479f11c4c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.171818 Aug 24 11:13:15.976105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 325/677] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:15 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:17.002612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:17.003575 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:17.012009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:17.012437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:17.012889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:17.013506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:17.013960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:17.014448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:17.160341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:17.169466 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:17.170924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:17.172103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-bfb5dcfe-8a56-41ba-ab6b-f38a200a56aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.176006 Aug 24 11:13:17.172654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 353/678] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:16 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:18.200177 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:18.201125 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:18.211510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:18.211988 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:18.212421 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:18.213102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:18.213552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:18.213968 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:18.358335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:18.367662 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:18.369138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:18.370283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-72303f07-7c8d-451e-8abf-d44add1efd3e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.176936 Aug 24 11:13:18.370800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 326/679] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:18 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:19.392895 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:19.393520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:19.400133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:19.400615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:19.401042 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:19.401720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:19.402164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:19.402576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:19.539723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:19.549179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:19.550654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:19.551870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2cc9d955-9822-4aa0-a532-6603394be388 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1808 microversion: 2.20 time: 0.162872 Aug 24 11:13:19.552610 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 354/680] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:19 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:20.577401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:20.578010 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:20.586684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:20.587356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:20.587856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:20.588654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:20.589185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:20.589729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:20.593079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=94 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:20.729607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:20.742338 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:20.744697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:20.746418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b6c15ac0-f201-43da-9c62-b5470ded8e7e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1795 microversion: 2.20 time: 0.173469 Aug 24 11:13:20.747179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 327/681] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:13:20 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1795 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:13:24.419355 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:13:24.420352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Wed Aug 24 11:13:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:13:44.300064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:44.301088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:44.304276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:44.305067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=48 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:44.311687 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:44.312498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:44.313276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:44.314523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:44.315385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:44.316162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:44.420579 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lazy-loading 'services' on Instance uuid c7140e32-0590-472a-a151-bd551fb262fe {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:13:44.505080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3fa8706b-7cee-45a6-bb52-910a8cd9f1d6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-volume_attachments/6b13fa5f-8f1c-4d90-9cb3-a8e47d945eb2" status: 202 len: 0 microversion: 2.1 time: 0.211370 Aug 24 11:13:44.505684 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 355/682] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:13:44 2022] DELETE /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-volume_attachments/6b13fa5f-8f1c-4d90-9cb3-a8e47d945eb2 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:13:45.626865 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-16ad6607-4aa0-4901-b461-e60fc5f0d2ca tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:45.629588 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=25 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:45.630218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=5 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:13:45.636317 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16ad6607-4aa0-4901-b461-e60fc5f0d2ca tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:45.636815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16ad6607-4aa0-4901-b461-e60fc5f0d2ca tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:45.637251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-16ad6607-4aa0-4901-b461-e60fc5f0d2ca tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:45.666992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-16ad6607-4aa0-4901-b461-e60fc5f0d2ca tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Going to try to stop instance {{(pid=120788) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:13:45.722522 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-16ad6607-4aa0-4901-b461-e60fc5f0d2ca tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action" status: 202 len: 0 microversion: 2.1 time: 0.099200 Aug 24 11:13:45.723168 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 328/683] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:13:45 2022] POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:13:45.732736 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:45.733410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:45.739935 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:45.740378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:45.740804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:45.741525 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:45.742666 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:45.742666 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:45.884848 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:45.892565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e96cefd9-ef95-4988-a914-c037f92e22c4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.164655 Aug 24 11:13:45.893114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 356/684] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:45 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:46.782642 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cbb1772-65fe-46b8-99a1-3a158c460b39"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:46.785128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:46.791558 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:46.792034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:46.792461 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:46.793138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:46.793585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:46.794206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:46.914158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:46.914766 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:46.921599 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:46.922075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:46.922501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:46.923217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:46.923655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:46.924075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:47.069462 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:47.077204 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9243adaa-0937-4fcc-a79f-0b70a637e6a6 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547744 Aug 24 11:13:47.077982 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 329/685] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:13:46 2022] POST /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:13:47.078423 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2e7fc551-023a-40f6-b55b-b8c6a26d7d9d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.168369 Aug 24 11:13:47.079134 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 357/686] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:46 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:48.105578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:48.106691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:48.116829 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:48.117311 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:48.117738 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:48.118419 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:48.118867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:48.119316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:48.252380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:48.260059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-dc5b6018-6541-4ca7-8904-e346c90d047b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.162329 Aug 24 11:13:48.260605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 330/687] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:48 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:49.282105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:49.282741 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:49.289453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:49.289958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:49.290379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:49.291081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:49.291524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:49.291934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:49.433008 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:49.441133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2c5c11ef-c617-44ca-8780-4986179e8286 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.163304 Aug 24 11:13:49.441655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 358/688] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:49 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:50.463908 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:50.464514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:50.471026 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:50.471536 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:50.471968 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:50.472648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:50.473097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:50.473520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:50.609706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:50.618648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9f75320c-9ef7-492b-968e-7ecddb04c58d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.159635 Aug 24 11:13:50.619210 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 331/689] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:50 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:51.646215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:51.647509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:51.654186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:51.654653 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:51.655079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:51.655777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:51.656208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:51.656615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:51.796237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:51.806320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3d2a9968-cef3-4530-822c-ff5bd295ad57 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.166367 Aug 24 11:13:51.806889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 359/690] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:51 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:52.829585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:52.830336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:52.839306 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:52.839872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:52.840439 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:52.841287 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:52.841847 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:52.842371 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:52.985498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:52.995351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a8144707-7716-4cab-a0e8-c1b53dd5eb40 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.170529 Aug 24 11:13:52.995918 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 332/691] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:52 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:54.020414 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:54.021086 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:54.028912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:54.029398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:54.029847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:54.030538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:54.030988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:54.031498 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:54.165044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:54.172880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e01f93a2-af1e-41eb-bee7-a65989009d5a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.156422 Aug 24 11:13:54.173459 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 360/692] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:54 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:54.656800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:13:54.659088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:54.666425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:54.666902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:54.667365 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:54.668042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:54.668491 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:54.668926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:54.692451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lazy-loading 'flavor' on Instance uuid ec7d6ae8-160f-49f0-ae59-b2986c77f579 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:13:54.863265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a1b0f251-7ba3-45d8-ad09-7b3c2a206606 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/action" status: 200 len: 32 microversion: 2.1 time: 0.210718 Aug 24 11:13:54.863866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 333/693] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:13:54 2022] POST /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:13:54.875000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:54.875770 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:54.882595 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:54.883023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:54.883513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:54.884219 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:54.884663 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:54.885219 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:55.022116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:55.032647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-97d194cf-4d57-42c6-9bfd-2c551e5ffd38 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.162525 Aug 24 11:13:55.033245 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 361/694] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:54 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:55.195112 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:55.195915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:55.202129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:55.202592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:55.203002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:55.203698 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:55.204141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:55.204546 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:55.338238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:55.346167 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3c066eba-7587-4394-b44d-eea0f3aba345 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.155555 Aug 24 11:13:55.346718 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 334/695] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:55 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:56.053771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:56.054416 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:56.061082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:56.061545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:56.061998 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:56.062674 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:56.063148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:56.063561 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:56.208066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:56.217702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-32d36f51-cea4-4660-bddf-b19c28e48de1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.168025 Aug 24 11:13:56.218301 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 362/696] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:56 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:56.375706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:56.376394 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:56.385413 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:56.386061 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:56.386607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:56.387552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:56.388150 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:56.388695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:56.529155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:56.537114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13f35a79-b780-4da9-bd7d-ab2f4ae18b2d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.172140 Aug 24 11:13:56.537650 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 335/697] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:56 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:57.239551 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:57.240158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:57.246932 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:57.247447 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:57.247870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:57.248550 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:57.248993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:57.249411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:57.385110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:57.393951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cf118393-3a12-4527-8018-3c4c8c706c85 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.158486 Aug 24 11:13:57.394493 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 363/698] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:57 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:57.566966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:57.567720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:57.576110 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:57.576706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:57.577246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:57.578087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:57.578637 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:57.579187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:57.720782 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:57.728594 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ef2e19a3-5358-4eaa-bd78-69e4446ceeaf tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.166620 Aug 24 11:13:57.729193 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 336/699] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:57 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:58.432205 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:58.432205 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:58.439908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:58.440394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:58.441072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:58.442298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:58.443118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:58.443905 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:58.609160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:58.619077 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-02d1d7a4-ee93-4774-bf6d-c91f8c24394b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.191541 Aug 24 11:13:58.619687 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 364/700] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:58 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:58.756181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:58.756855 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:58.767261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:58.767928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:58.768646 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:58.770968 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:58.772180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:58.772618 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:58.949154 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:58.957206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ec5bf1e8-b4d3-41dd-be3a-0211286da742 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.205059 Aug 24 11:13:58.957739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 337/701] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:58 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:59.649390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:59.650299 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:59.661760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:59.662619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:59.663386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:59.664512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:59.665282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:59.665971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:13:59.804159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:13:59.812599 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0b6a3943-03f0-450a-921e-3a2e08b5e1dc tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.169830 Aug 24 11:13:59.813363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 365/702] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:59 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:13:59.986526 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:13:59.987787 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:13:59.998242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:13:59.998712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:13:59.999185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:00.000038 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:00.000328 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:00.000814 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:00.133180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:00.142137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-af7f3bc8-70aa-413d-a81f-7ee8930e9c20 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.162260 Aug 24 11:14:00.142703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 338/703] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:13:59 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:00.837885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:00.838565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:00.845494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:00.845972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:00.846396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:00.847104 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:00.847552 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:00.847961 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:01.004521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:01.015950 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a05e158e-34a2-4fc2-add4-90b0e4fbff52 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.184928 Aug 24 11:14:01.016522 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 366/704] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:00 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:01.174644 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:01.175242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:01.184668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:01.185328 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:01.185914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:01.186749 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:01.187391 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:01.187923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:01.325275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:01.334812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5f3f2918-f61e-483d-acb5-b136c2c7fdbd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.166271 Aug 24 11:14:01.335572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 339/705] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:01 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:02.038699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:02.039418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:02.047451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:02.048009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:02.048509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:02.049307 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:02.049834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:02.050323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:02.189588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:02.203396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-bde64ad7-7dae-4afd-969c-7047fc6faf12 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.168800 Aug 24 11:14:02.204318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 367/706] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:02 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:02.359387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:02.360118 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:02.367202 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:02.367712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:02.368164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:02.368902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:02.369369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:02.369805 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:02.374341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:02.517295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:02.529261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-325d3adb-94b7-4cef-aae6-ff868b7914df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.174296 Aug 24 11:14:02.530065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 340/707] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:02 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:03.231437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:03.232058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:03.238842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:03.239359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:03.239790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:03.240475 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:03.240921 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:03.241335 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:03.387080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:03.395990 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3d5cfca9-65ff-4376-8717-7fcf62741cdd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.169509 Aug 24 11:14:03.396554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 368/708] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:03 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:03.556231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:03.556805 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:03.564587 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:03.565563 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:03.566001 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:03.566699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:03.567325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:03.567775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:03.708308 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:03.717316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac09833a-d725-4bb9-af0b-6c8524b349da tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.166553 Aug 24 11:14:03.717957 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 341/709] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:03 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:04.423158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:04.424136 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:04.435011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:04.435158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:04.435519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:04.436209 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:04.436657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:04.437093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:04.579621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:04.588207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-526cbcad-b6ff-443d-92dc-5c3b9faba94a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.171606 Aug 24 11:14:04.588751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 369/710] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:04 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:04.741633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:04.742196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:04.751965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:04.752629 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:04.753246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:04.753935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:04.754546 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:04.755161 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:04.892635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:04.905126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0a598002-f1f0-4cf5-8401-e21cf03fdfac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.169839 Aug 24 11:14:04.905712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 342/711] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:04 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:05.612082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:05.612880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:05.625102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:05.625819 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:05.626415 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:05.627451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:05.628049 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:05.628674 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:05.764456 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:05.768024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:05.773519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-549eb011-0e32-4d44-a589-7b05b4427a31 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.166928 Aug 24 11:14:05.774087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 370/712] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:05 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:05.926196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:05.926771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:05.933642 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:05.934121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:05.934552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:05.935294 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:05.935737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:05.936159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:06.071120 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:06.078977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0106ea4e-e191-4911-826f-d2a173d1d97e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1678 microversion: 2.1 time: 0.156840 Aug 24 11:14:06.079586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 343/713] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:05 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:06.797261 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:06.797921 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:06.807480 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:06.808063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:06.808508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:06.809181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:06.809641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:06.810048 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:06.948799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:06.957664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-66335a36-0bb5-435c-ae5c-43d12a94455f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.165627 Aug 24 11:14:06.958237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 371/714] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:06 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:07.104753 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:07.105342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:07.112170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.112652 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.113076 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.113742 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.114184 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.114636 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.268041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:07.275869 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cc6fcb4e-966d-41fa-bbbf-1edcaecf8f21 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1655 microversion: 2.1 time: 0.177197 Aug 24 11:14:07.276439 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 344/715] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:07 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1655 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:07.296658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d1ead79a-3e96-4860-be21-bb81ac3a7552 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:07.303083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d1ead79a-3e96-4860-be21-bb81ac3a7552 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.303548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d1ead79a-3e96-4860-be21-bb81ac3a7552 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.303970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d1ead79a-3e96-4860-be21-bb81ac3a7552 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.366259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d1ead79a-3e96-4860-be21-bb81ac3a7552 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Going to try to start instance {{(pid=120789) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:14:07.413336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d1ead79a-3e96-4860-be21-bb81ac3a7552 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action" status: 202 len: 0 microversion: 2.1 time: 0.120628 Aug 24 11:14:07.413916 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 372/716] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:14:07 2022] POST /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:14:07.422445 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:07.423262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:07.429626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.430173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.430798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.431590 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.432046 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.432613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.576268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:07.584019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-10329eac-32e6-45f8-b1f7-908c09d9e38e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1664 microversion: 2.1 time: 0.165692 Aug 24 11:14:07.584871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 345/717] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:07 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:07.983192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:07.984043 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:07.993518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.994270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.994940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:07.995968 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:07.996621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:07.997076 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:08.127724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:08.136010 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-be0fde61-8f7e-4fb3-a00c-f020865b3e50 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1737 microversion: 2.1 time: 0.159825 Aug 24 11:14:08.136577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 373/718] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:07 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:08.604993 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:08.605745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:08.612331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:08.612803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:08.613229 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:08.613900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:08.614339 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:08.614718 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:08.751249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:08.759158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e74fbcdb-f6ab-4347-a513-1b9a58a594e6 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1664 microversion: 2.1 time: 0.158120 Aug 24 11:14:08.759731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 346/719] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:08 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:09.161749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:09.162652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:09.174126 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.174710 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.175243 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.176200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.176797 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.177350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.320264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:09.329222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-df4a4cf4-997b-4121-bc99-490b9f83a066 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1717 microversion: 2.1 time: 0.173816 Aug 24 11:14:09.329879 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 374/720] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:09 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:09.392461 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:09.393159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:09.401315 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.401879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.402848 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.404136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.404634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.405226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.534026 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] HTTP exception thrown: Cannot 'detach_volume' instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 while it is in vm_state rescued Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Request method failure captured: Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments/2cbb1772-65fe-46b8-99a1-3a158c460b39 HTTP/1.1 Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZNTWI46EyWOVthpnrkpQbS04WegfQ-JCzszT53sEwlXHpfW8PBTRCrT4o6AmA1pbqg-yl54Vcrv1zn938p0u8pmb_DzHMe6n-Og-swCi7u1baTQpfDPBYLvWWiCbrZMMCuXPfwEwrOKYrhsSgRP_13YhN_GvDbhsgWI1W6c2dc6K4 Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:14:09.535695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18b9988b1131422f9db644695c1df22d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18b9988b1131422f9db644695c1df22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: e808c04cd77d446ca2c05712868b7ce3 Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:14:09.537239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Cannot 'detach_volume' instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 while it is in vm_state rescued Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'server_id': 'ec7d6ae8-160f-49f0-ae59-b2986c77f579', 'id': '2cbb1772-65fe-46b8-99a1-3a158c460b39'} Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:14:09.538169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 while it is in vm_state rescued Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 while it is in vm_state rescued Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:14:09.540009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Returning 409 to user: Cannot 'detach_volume' instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 while it is in vm_state rescued {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:14:09.541403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-66ae9d5d-4484-4c90-9d94-17ba5eaf090f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments/2cbb1772-65fe-46b8-99a1-3a158c460b39" status: 409 len: 152 microversion: 2.1 time: 0.148977 Aug 24 11:14:09.541403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 347/721] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:14:09 2022] DELETE /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments/2cbb1772-65fe-46b8-99a1-3a158c460b39 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:14:09.546402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:09.546928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:09.553333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.553816 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.554246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.554923 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.555403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.555821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.635156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0c825802-9b96-4ab2-bd8e-b6f9ceaad650 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "POST /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/action" status: 202 len: 0 microversion: 2.1 time: 0.092757 Aug 24 11:14:09.635790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 375/722] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:14:09 2022] POST /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:14:09.644530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:09.645819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:09.654457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.654933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.655378 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.656074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.656488 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.656894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.781554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:09.782236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:09.788427 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.788878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.789333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.790020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:09.790433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:09.790842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:09.790954 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:09.799756 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-30df407c-1e27-4f6a-a614-63999bae02bd tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1725 microversion: 2.1 time: 0.159319 Aug 24 11:14:09.800341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 348/723] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:09 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:09.926524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:09.934617 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-abd4b5b4-57f7-4880-8253-c1d15fba07aa tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1668 microversion: 2.1 time: 0.157703 Aug 24 11:14:09.935480 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 376/724] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:09 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:10.821652 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:10.822214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:10.829519 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:10.829993 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:10.830409 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:10.831167 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:10.831552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:10.831960 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:10.963351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:10.971745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5c95a85b-96a8-4dfb-9317-1eefce91dd87 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1725 microversion: 2.1 time: 0.154220 Aug 24 11:14:10.972301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 349/725] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:10 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:11.994639 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:11.995327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:12.002931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:12.003450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:12.003879 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:12.004564 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:12.005020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:12.005433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:12.149383 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:12.158146 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-255827a1-0894-47d3-8bdb-d9d6c7d3b2c1 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1725 microversion: 2.1 time: 0.168251 Aug 24 11:14:12.158706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 377/726] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:11 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:13.183610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:13.184575 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:13.195477 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:13.196319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:13.197014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:13.198123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:13.198881 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:13.199827 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:13.351545 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:13.360367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7b39e998-ffb9-4dc0-9305-7f94bc2deb99 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1731 microversion: 2.1 time: 0.183307 Aug 24 11:14:13.360938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 350/727] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:13 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:13.380784 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:13.381323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:13.388378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:13.388863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:13.389273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:13.389943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:13.390384 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:13.390792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:13.469364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a90d35d4-bd34-4176-b219-6265a071cd71 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092012 Aug 24 11:14:13.470183 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 378/728] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:14:13 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:14.586506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-b97928b2-a24e-487f-b0dc-b9aaa8e5000a req-b1523934-95b4-4cea-80ee-fbdb2148e26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec7d6ae8-160f-49f0-ae59-b2986c77f579", "tag": "5263f317-1ef6-49d4-bae2-2c20bcd761f0"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:14.597112 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b97928b2-a24e-487f-b0dc-b9aaa8e5000a req-b1523934-95b4-4cea-80ee-fbdb2148e26c service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:14.597919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b97928b2-a24e-487f-b0dc-b9aaa8e5000a req-b1523934-95b4-4cea-80ee-fbdb2148e26c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:14.598302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-b97928b2-a24e-487f-b0dc-b9aaa8e5000a req-b1523934-95b4-4cea-80ee-fbdb2148e26c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:14.610890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-b97928b2-a24e-487f-b0dc-b9aaa8e5000a req-b1523934-95b4-4cea-80ee-fbdb2148e26c service nova] Creating event network-changed:5263f317-1ef6-49d4-bae2-2c20bcd761f0 for instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 on hv-cinder-85427 Aug 24 11:14:14.617097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-b97928b2-a24e-487f-b0dc-b9aaa8e5000a req-b1523934-95b4-4cea-80ee-fbdb2148e26c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034201 Aug 24 11:14:14.617696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 351/729] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:16.121212 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:16.127751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:16.130961 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=49 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:16.139456 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:16.139934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:16.140325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:16.141044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:16.141489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:16.141904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:16.173754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1d1f2eca-ae35-4535-ad90-44772bccc10d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments/7b309fe5-140e-4a1b-a5a0-b857d4e59d97" status: 200 len: 194 microversion: 2.20 time: 0.060494 Aug 24 11:14:16.174328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 379/730] 10.222.0.79 () {60 vars in 1454 bytes} [Wed Aug 24 11:14:16 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments/7b309fe5-140e-4a1b-a5a0-b857d4e59d97 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:14:16.251102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:16.251675 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:16.253624 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=49 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:16.260806 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:16.261501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:16.262316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:16.263294 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:16.264081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:16.264748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:16.359443 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lazy-loading 'services' on Instance uuid 2e7358f8-2cd1-41ac-a439-4630ad8630bc {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:14:16.488034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aa7cce9c-3dba-4149-99e3-d03815d210ea tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments/7b309fe5-140e-4a1b-a5a0-b857d4e59d97" status: 202 len: 0 microversion: 2.20 time: 0.241726 Aug 24 11:14:16.488748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 352/731] 10.222.0.79 () {60 vars in 1457 bytes} [Wed Aug 24 11:14:16 2022] DELETE /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments/7b309fe5-140e-4a1b-a5a0-b857d4e59d97 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:14:16.498665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:16.500927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:16.506959 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:16.507521 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:16.507933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:16.508696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:16.509064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:16.509450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:16.541201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6d86e6d0-07dd-4052-9fed-5d6b7bc2bda5 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047390 Aug 24 11:14:16.541812 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 380/732] 10.222.0.79 () {60 vars in 1343 bytes} [Wed Aug 24 11:14:16 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:14:16.636164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-282c5f71-b2be-4bf8-aaba-4bcdb03be757 req-92b599f2-77de-40bf-ae63-dc1147e2117c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec7d6ae8-160f-49f0-ae59-b2986c77f579", "tag": "5263f317-1ef6-49d4-bae2-2c20bcd761f0"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:16.652167 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-282c5f71-b2be-4bf8-aaba-4bcdb03be757 req-92b599f2-77de-40bf-ae63-dc1147e2117c service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:16.652961 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-282c5f71-b2be-4bf8-aaba-4bcdb03be757 req-92b599f2-77de-40bf-ae63-dc1147e2117c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:16.653384 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-282c5f71-b2be-4bf8-aaba-4bcdb03be757 req-92b599f2-77de-40bf-ae63-dc1147e2117c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:16.665452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-282c5f71-b2be-4bf8-aaba-4bcdb03be757 req-92b599f2-77de-40bf-ae63-dc1147e2117c service nova] Creating event network-changed:5263f317-1ef6-49d4-bae2-2c20bcd761f0 for instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 on hv-cinder-85427 Aug 24 11:14:16.670632 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-282c5f71-b2be-4bf8-aaba-4bcdb03be757 req-92b599f2-77de-40bf-ae63-dc1147e2117c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041945 Aug 24 11:14:16.671139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 353/733] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:17.554041 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:17.556327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:17.563015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.563510 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.563937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.564623 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.565051 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.565459 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.595792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-46d9e4f0-7d8f-4fbf-8df0-09d80b195eff tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046476 Aug 24 11:14:17.596399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 381/734] 10.222.0.79 () {60 vars in 1343 bytes} [Wed Aug 24 11:14:17 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:17.661480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:17.662024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:17.668403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.669113 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.669543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.670218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.670659 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.671085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.699164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:14:17.791259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-778232ed-b98a-4b40-a3d7-0faa452458ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 204 len: 0 microversion: 2.20 time: 0.134450 Aug 24 11:14:17.791846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 354/735] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 24 11:14:17 2022] DELETE /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:14:17.800448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:17.801071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:17.807195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.807594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.808012 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.808915 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:17.809499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:17.809906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:17.950399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:17.962112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:17.964625 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:17.965940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-49190699-de55-4a79-96a5-d5556ca895aa tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.169405 Aug 24 11:14:17.966511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 382/736] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:17 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:18.991088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:18.991932 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:19.000334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:19.000901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:19.001433 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:19.002210 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:19.002748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:19.003284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:19.148008 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:19.153408 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:19.161451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:19.163747 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:19.165495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-531f2007-66b5-48da-9a7a-2a1cfd22d40a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.179301 Aug 24 11:14:19.166263 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 355/737] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:18 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:20.191007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:20.191733 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:20.198711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:20.199359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:20.199781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:20.200474 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:20.200917 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:20.201328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:20.336570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:20.345534 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:20.346993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:20.348155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-848e3741-7843-4931-89be-e10f3229481f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 200 len: 1723 microversion: 2.20 time: 0.161288 Aug 24 11:14:20.348695 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 383/738] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:20 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:20.662721 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-24f6494a-3db1-4c9f-8468-905f22c89e16 req-2ce77f50-e5df-4663-9f4b-1e296d491f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7358f8-2cd1-41ac-a439-4630ad8630bc", "name": "network-vif-deleted", "tag": "3265d28a-dfe5-435c-80d8-88ded1a20382"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:20.676679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-24f6494a-3db1-4c9f-8468-905f22c89e16 req-2ce77f50-e5df-4663-9f4b-1e296d491f4f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:20.677049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-24f6494a-3db1-4c9f-8468-905f22c89e16 req-2ce77f50-e5df-4663-9f4b-1e296d491f4f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:20.678318 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-24f6494a-3db1-4c9f-8468-905f22c89e16 req-2ce77f50-e5df-4663-9f4b-1e296d491f4f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:20.700930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-24f6494a-3db1-4c9f-8468-905f22c89e16 req-2ce77f50-e5df-4663-9f4b-1e296d491f4f service nova] Creating event network-vif-deleted:3265d28a-dfe5-435c-80d8-88ded1a20382 for instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc on hv-cinder-85427 Aug 24 11:14:20.706223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-24f6494a-3db1-4c9f-8468-905f22c89e16 req-2ce77f50-e5df-4663-9f4b-1e296d491f4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047444 Aug 24 11:14:20.706811 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 356/739] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:21.375001 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:21.376251 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:21.382450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:21.382994 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:21.383474 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:21.384224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:21.384730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:21.385223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:21.399982 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] HTTP exception thrown: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Request method failure captured: Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc HTTP/1.1 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZOn0Ds_E8WFOk5eJo3i-rp3WVuuO-EJK1TcA9fB3LZkmdgRrMlI3JJHV_7GnZLSenv8-SzbWcZ7CJNgavuStXRk7lnLYrM0PiRr4ZAIdoo8VYeUeDus92L4AqsaFfkXijgRfaYqeYMy4aLFnApvZLlLty1DEDdgSFjhl5BRzJk0l8 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:14:21.402068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_89fc202cd0ae4c47ac947b30aa71e215", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: d53266f9532a4250bf4d1159621493a9 Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:14:21.403960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '2e7358f8-2cd1-41ac-a439-4630ad8630bc'} Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:14:21.405284 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:14:21.410404 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:14:21.411865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Returning 404 to user: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:14:21.411865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6d2b8651-e169-4899-bcb8-86d3d23bfa0f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 404 len: 111 microversion: 2.20 time: 0.037188 Aug 24 11:14:21.411865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 384/740] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:21 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:14:21.415487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-08ed0763-8eaa-4e9b-8172-27462e9acabf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '.version_select at 0x7f82b7f5fc10>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:21.420229 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08ed0763-8eaa-4e9b-8172-27462e9acabf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:14:22.433769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [None req-08ed0763-8eaa-4e9b-8172-27462e9acabf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44786. Aug 24 11:14:22.455235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-08ed0763-8eaa-4e9b-8172-27462e9acabf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237646602" status: 204 len: 0 microversion: 2.20 time: 1.043981 Aug 24 11:14:22.455837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 357/741] 10.222.0.79 () {60 vars in 1259 bytes} [Wed Aug 24 11:14:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237646602 => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:14:23.156208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5f6afa13-cec6-433b-9473-0be945d62ab8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'create', calling method: .version_select at 0x7f82b625cee0>, body: {"keypair": {"name": "tempest-keypair-1653145090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAG4VeSdZd6L+64+Eu9wHH8QO3xJGMzXzFlR2nTYAyz/8H6xtlrcDFTyDew7MGDKpEL5XeiwRzYb/C+wuJPK4RaCS4CD3bKEeVpAWQulvxDEMEaHYPNY6Y++xBNbEY8yA=="}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:23.173020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-5f6afa13-cec6-433b-9473-0be945d62ab8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:14:23.177292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-5f6afa13-cec6-433b-9473-0be945d62ab8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for user d53266f9532a4250bf4d1159621493a9 and project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:14:23.207299 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5f6afa13-cec6-433b-9473-0be945d62ab8 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055597 Aug 24 11:14:23.207874 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 385/742] 10.222.0.79 () {62 vars in 1200 bytes} [Wed Aug 24 11:14:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 11:14:24.811569 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1402081088", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd5d20ae-4f6b-4d40-8e79-dbb1adb53674"}], "security_groups": [{"name": "tempest-securitygroup--2050295058"}], "key_name": "tempest-keypair-1653145090", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:24.933880 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] validate_networks() for [('cd5d20ae-4f6b-4d40-8e79-dbb1adb53674', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:14:25.317960 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:14:25.318501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:14:25.319197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:14:25.319636 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:14:25.320097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:14:25.334464 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:25.335216 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:25.335882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:25.337065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:25.337655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:25.338250 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:25.356863 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:14:25.361225 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Getting quotas for user d53266f9532a4250bf4d1159621493a9 and project 89fc202cd0ae4c47ac947b30aa71e215. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:14:25.373357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:14:25.375778 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:14:25.433802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-32938def-bd62-405f-acb6-84b5a3810e32 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.628496 Aug 24 11:14:25.434843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 358/743] 10.222.0.79 () {62 vars in 1188 bytes} [Wed Aug 24 11:14:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 11:14:25.446452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6d0da818-934b-43fb-b90d-b81b64b5c8ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:25.447070 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6d0da818-934b-43fb-b90d-b81b64b5c8ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:25.506698 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6d0da818-934b-43fb-b90d-b81b64b5c8ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:25.514211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6d0da818-934b-43fb-b90d-b81b64b5c8ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:25.515735 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6d0da818-934b-43fb-b90d-b81b64b5c8ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:25.516835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6d0da818-934b-43fb-b90d-b81b64b5c8ed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1282 microversion: 2.20 time: 0.075029 Aug 24 11:14:25.517409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 386/744] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:25 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:26.541486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:26.542192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:26.549398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:26.549947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:26.550381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:26.551091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:26.551538 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:26.552251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:26.616642 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:26.626129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:26.627882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:26.629316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-80875a21-f14d-429c-9997-4d0d1295f58d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1352 microversion: 2.20 time: 0.093018 Aug 24 11:14:26.643959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 359/745] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:26 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:27.654163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:27.654898 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:27.661550 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:27.662022 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:27.662453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:27.663193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:27.663646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:27.664061 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:27.806570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:27.815507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:27.817009 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:27.818109 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-870b77ca-340d-42f7-8365-edc0c5b6d448 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1408 microversion: 2.20 time: 0.168729 Aug 24 11:14:27.818694 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 387/746] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:27 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:27.943274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-adc3d3e5-ae44-4732-b033-56f5d312a148 req-51bb6770-23d4-4d5b-9c31-8c8160b002bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12fb1be-eff8-42a1-9818-6cf5681c6917", "tag": "db943507-5258-4e45-8aaa-0ce5bc112e88"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:27.956004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-adc3d3e5-ae44-4732-b033-56f5d312a148 req-51bb6770-23d4-4d5b-9c31-8c8160b002bd service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:27.956552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-adc3d3e5-ae44-4732-b033-56f5d312a148 req-51bb6770-23d4-4d5b-9c31-8c8160b002bd service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:27.957094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-adc3d3e5-ae44-4732-b033-56f5d312a148 req-51bb6770-23d4-4d5b-9c31-8c8160b002bd service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:27.970638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-adc3d3e5-ae44-4732-b033-56f5d312a148 req-51bb6770-23d4-4d5b-9c31-8c8160b002bd service nova] Creating event network-changed:db943507-5258-4e45-8aaa-0ce5bc112e88 for instance a12fb1be-eff8-42a1-9818-6cf5681c6917 on hv-cinder-85427 Aug 24 11:14:27.975570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-adc3d3e5-ae44-4732-b033-56f5d312a148 req-51bb6770-23d4-4d5b-9c31-8c8160b002bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036233 Aug 24 11:14:27.976437 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 360/747] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:28.841114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:28.841715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:28.848878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:28.849330 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:28.849758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:28.850442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:28.850933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:28.851358 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:28.869618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:28.986260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:28.995089 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:28.997204 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:28.998313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fa3a2f6d-5d5d-43a6-bdc7-36b587fe36cf tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1408 microversion: 2.20 time: 0.161294 Aug 24 11:14:28.998873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 388/748] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:28 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:30.025794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:30.027450 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:30.034129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:30.034586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:30.035036 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:30.035747 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:30.036190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:30.036601 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:30.175337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:30.187869 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:30.190278 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:30.192140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3ee449bc-a466-48e7-a3f7-26c2f1d710f0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1408 microversion: 2.20 time: 0.173373 Aug 24 11:14:30.192981 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 361/749] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:30 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:31.216811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:31.217414 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:31.223998 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:31.224473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:31.224893 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:31.225567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:31.226010 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:31.226419 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:31.363362 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:31.371564 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:31.373040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:31.374129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-29a07a28-2f39-499c-a8fc-8676e8b2d545 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1408 microversion: 2.20 time: 0.161411 Aug 24 11:14:31.374680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 389/750] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:31 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:32.400549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:32.401788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:32.412544 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:32.413366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:32.414351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:32.415556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:32.416329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:32.417019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:32.547126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:32.555559 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:32.557035 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:32.558180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f256c611-9ea0-4899-82d4-8f06ff752afb tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1408 microversion: 2.20 time: 0.164188 Aug 24 11:14:32.558729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 362/751] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:32 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:32.751858 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-191c268f-9cdb-41e5-a714-c062aeafd106 req-e015ca70-e305-46cb-83f9-21c252e59658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12fb1be-eff8-42a1-9818-6cf5681c6917", "name": "network-vif-plugged", "status": "completed", "tag": "db943507-5258-4e45-8aaa-0ce5bc112e88"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:32.764081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-191c268f-9cdb-41e5-a714-c062aeafd106 req-e015ca70-e305-46cb-83f9-21c252e59658 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:32.764565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-191c268f-9cdb-41e5-a714-c062aeafd106 req-e015ca70-e305-46cb-83f9-21c252e59658 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:32.765021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-191c268f-9cdb-41e5-a714-c062aeafd106 req-e015ca70-e305-46cb-83f9-21c252e59658 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:32.777101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-191c268f-9cdb-41e5-a714-c062aeafd106 req-e015ca70-e305-46cb-83f9-21c252e59658 service nova] Creating event network-vif-plugged:db943507-5258-4e45-8aaa-0ce5bc112e88 for instance a12fb1be-eff8-42a1-9818-6cf5681c6917 on hv-cinder-85427 Aug 24 11:14:32.782136 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-191c268f-9cdb-41e5-a714-c062aeafd106 req-e015ca70-e305-46cb-83f9-21c252e59658 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033938 Aug 24 11:14:32.782726 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 390/752] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:33.584709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:33.585601 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:33.594148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:33.594626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:33.595072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:33.595752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:33.596194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:33.596603 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:33.739413 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:33.749485 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:33.750960 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:33.752107 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2818d0db-0f62-45ee-ade7-a6941763d8db tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1408 microversion: 2.20 time: 0.173994 Aug 24 11:14:33.752685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 363/753] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:33 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:34.788495 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:34.790028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:34.797577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:34.798050 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:34.798470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:34.799181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:34.799621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:34.800029 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:34.950175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:34.958739 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:34.960259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:34.961365 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b96d07be-c0d1-488e-9e07-1e8fb254da29 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1408 microversion: 2.20 time: 0.180233 Aug 24 11:14:34.961929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 391/754] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:34 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:35.051691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:35.052274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:35.059156 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:35.059630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:35.060056 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:35.060732 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:35.061175 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:35.061585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:35.083995 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lazy-loading 'flavor' on Instance uuid 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:14:35.164440 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-427c9ae5-59d9-4107-939a-f3ced3198dfd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "POST /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.117892 Aug 24 11:14:35.165062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 364/755] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:14:35 2022] POST /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:14:35.173472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:35.174063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:35.180576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:35.181177 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:35.181598 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:35.182256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:35.182711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:35.183282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:35.318848 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:35.326832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4315805c-a740-420a-a91e-980e5fc3e912 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.157147 Aug 24 11:14:35.327433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 392/756] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:35 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:35.984201 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:35.985194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:35.992114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:35.993320 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:36.001598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:36.002075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:36.002499 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:36.003228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:36.003670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:36.004085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:36.145190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:36.154988 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:36.157021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:36.158176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d76ad6ab-4c39-44da-8731-d43812694029 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1601 microversion: 2.20 time: 0.175874 Aug 24 11:14:36.158727 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 365/757] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:14:35 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:14:36.184021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:36.184556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:36.186453 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:36.192568 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:36.193072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:36.193491 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:36.194178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:36.194621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:36.195029 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:36.271254 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f08ad3fd-b5bd-44c1-818e-b981683b8fed tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091609 Aug 24 11:14:36.271854 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 393/758] 10.222.0.79 () {60 vars in 1316 bytes} [Wed Aug 24 11:14:36 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:14:36.347699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:36.348296 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:36.354525 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:36.355138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:36.355566 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:36.356244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:36.356686 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:36.357109 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:36.593017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:36.601270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-90bb0560-1288-48c8-a7d2-77ed3aa58d62 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.257453 Aug 24 11:14:36.601812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 366/759] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:36 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:37.599748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-f5c2a826-b707-4431-b005-2f02352653b2 req-cbb29f57-cceb-412a-ade1-7977681db92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12fb1be-eff8-42a1-9818-6cf5681c6917", "tag": "db943507-5258-4e45-8aaa-0ce5bc112e88"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:37.609921 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f5c2a826-b707-4431-b005-2f02352653b2 req-cbb29f57-cceb-412a-ade1-7977681db92a service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:37.610398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f5c2a826-b707-4431-b005-2f02352653b2 req-cbb29f57-cceb-412a-ade1-7977681db92a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:37.610804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f5c2a826-b707-4431-b005-2f02352653b2 req-cbb29f57-cceb-412a-ade1-7977681db92a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:37.622771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-f5c2a826-b707-4431-b005-2f02352653b2 req-cbb29f57-cceb-412a-ade1-7977681db92a service nova] Creating event network-changed:db943507-5258-4e45-8aaa-0ce5bc112e88 for instance a12fb1be-eff8-42a1-9818-6cf5681c6917 on hv-cinder-85427 Aug 24 11:14:37.623217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:37.624028 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:37.628077 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-f5c2a826-b707-4431-b005-2f02352653b2 req-cbb29f57-cceb-412a-ade1-7977681db92a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099691 Aug 24 11:14:37.629067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 394/760] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:37.631530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:37.632168 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:37.632657 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:37.633405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:37.633935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:37.634352 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:37.786407 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:37.795225 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-628f0fe9-e25b-4cb8-bed3-7c8966b3e3bd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.175953 Aug 24 11:14:37.800762 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 367/761] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:37 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:38.818175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:38.818862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:38.826589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:38.827102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:38.827528 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:38.828208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:38.828654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:38.829068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:38.985059 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:38.997048 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-608ac143-176a-45a8-aa93-7e704f06a67a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.183065 Aug 24 11:14:38.997614 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 395/762] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:38 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:40.022424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:40.023442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:40.036140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:40.037002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:40.037871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:40.039324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:40.040324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:40.041178 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:40.183120 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:40.195019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-142cbdab-6262-4790-a580-2e10caf96f53 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.179093 Aug 24 11:14:40.195841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 368/763] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:40 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:41.218970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:41.219714 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:41.227553 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:41.228118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:41.228597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:41.229380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:41.229893 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:41.230374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:41.371323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:41.379298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4e916e8e-0573-432a-8cbf-499ab550b313 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.165230 Aug 24 11:14:41.379867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 396/764] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:41 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:42.406053 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:42.407021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:42.417704 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:42.418187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:42.418613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:42.419337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:42.419777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:42.420190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:42.566118 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:42.574590 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b8059356-1da4-46f2-b941-37a2b6281252 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.176012 Aug 24 11:14:42.575186 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 369/765] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:42 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:43.600007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:43.601485 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:43.614054 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:43.614912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:43.615726 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:43.616947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:43.617774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:43.618527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:43.769953 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:43.778629 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7aac984a-1389-4c4c-b9e5-986237c80f34 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.185096 Aug 24 11:14:43.779226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 397/766] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:43 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:44.803953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:44.804903 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:44.813061 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:44.813558 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:44.813979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:44.814653 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:44.815091 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:44.815527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:44.960221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:44.968187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-969ca36f-d6ae-4ee9-840d-a1cda2dc267e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.170763 Aug 24 11:14:44.968749 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 370/767] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:44 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:45.993170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:45.993911 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:46.004171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:46.004849 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:46.005411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:46.006442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:46.007125 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:46.007807 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:46.148321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:46.160561 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-181edf70-9ee9-40f6-b9f9-17f63214168d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.173165 Aug 24 11:14:46.161332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 398/768] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:45 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:47.186598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:47.192010 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:47.192010 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:47.200044 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:47.200670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:47.201143 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:47.202049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:47.202735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:47.203279 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:47.346020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:47.355495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-38360e45-8ba5-4ec6-b4f7-57006205c327 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.173826 Aug 24 11:14:47.356038 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 371/769] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:47 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:48.379083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:48.379955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:48.383473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:48.389820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:48.390300 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:48.390716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:48.391418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:48.391861 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:48.392271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:48.534710 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:48.545831 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b0bb4dc7-6d5b-4927-a32f-81c40302b29b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.171677 Aug 24 11:14:48.546622 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 399/770] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:48 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:49.571974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:49.572540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:49.579673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:49.580139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:49.580557 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:49.581231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:49.581672 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:49.582085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:49.718399 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:49.727259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7d354733-7fcb-4fd9-ae4c-16e31ee754a8 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.158987 Aug 24 11:14:49.727870 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 372/771] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:49 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:50.749331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:50.749925 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:50.756770 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:50.757318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:50.757755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:50.758427 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:50.758867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:50.759314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:50.897163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:50.907509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e41e3339-8d9c-4309-b83b-88d2f771bd77 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.162306 Aug 24 11:14:50.908075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 400/772] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:50 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:51.933986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:51.935037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:51.945081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:51.945871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:51.946562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:51.947706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:51.948435 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:51.949112 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:51.952363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:52.094789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:52.103067 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-747431ae-3721-4dc5-9a5d-2ad99d3566d4 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.175905 Aug 24 11:14:52.103637 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 373/773] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:51 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:53.124701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:53.125271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:53.131717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:53.132193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:53.132611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:53.133291 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:53.133734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:53.134142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:53.272506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:53.284544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-450626a5-7d7f-4688-abe3-396bf57c6c8a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.163692 Aug 24 11:14:53.285373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 401/774] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:53 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:54.310380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:54.311372 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:54.322168 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.322953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.323796 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.324923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.325767 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.326381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.476095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:54.484249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-18803329-230c-44e2-88ec-b7450224c127 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1511 microversion: 2.1 time: 0.180338 Aug 24 11:14:54.484814 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 374/775] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:54 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:54.512907 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:54.513520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:54.523543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.524189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.524742 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.526036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.526714 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.527346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.699529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120789) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:14:54.772820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-48a1cc25-5394-4c00-86f8-e61d335fce54 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "POST /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce/action" status: 202 len: 0 microversion: 2.1 time: 0.266623 Aug 24 11:14:54.773479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 402/776] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:14:54 2022] POST /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:14:54.781852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:54.782446 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:54.788604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.789073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.789488 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.790197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:54.790633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:54.791079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:54.942486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:54.950541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7725c8b3-bb5f-4c5b-8676-8135fd8efe05 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1519 microversion: 2.1 time: 0.172442 Aug 24 11:14:54.951387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 375/777] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:54 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:55.973532 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:55.974971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:55.981468 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:55.981988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:55.982413 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:55.983133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:55.983576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:55.983991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:56.122366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:56.134846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5262b04f-f868-4838-8978-a09fb299a30e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.166082 Aug 24 11:14:56.135721 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 403/778] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:55 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:56.790297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-553886ef-db9b-4023-8760-0ef573fb7fa5 req-bcd38b50-ba53-4560-9ade-4ae177ffc583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce", "name": "network-vif-unplugged", "status": "completed", "tag": "2bd4251a-385e-4718-b6a2-35c629d4bbb6"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:14:56.802662 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-553886ef-db9b-4023-8760-0ef573fb7fa5 req-bcd38b50-ba53-4560-9ade-4ae177ffc583 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:56.803182 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-553886ef-db9b-4023-8760-0ef573fb7fa5 req-bcd38b50-ba53-4560-9ade-4ae177ffc583 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:56.803844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-553886ef-db9b-4023-8760-0ef573fb7fa5 req-bcd38b50-ba53-4560-9ade-4ae177ffc583 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:56.820463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-553886ef-db9b-4023-8760-0ef573fb7fa5 req-bcd38b50-ba53-4560-9ade-4ae177ffc583 service nova] Creating event network-vif-unplugged:2bd4251a-385e-4718-b6a2-35c629d4bbb6 for instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce on hv-cinder-85427 Aug 24 11:14:56.826657 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-553886ef-db9b-4023-8760-0ef573fb7fa5 req-bcd38b50-ba53-4560-9ade-4ae177ffc583 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039458 Aug 24 11:14:56.827895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 376/779] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:14:57.160472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:57.161292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:57.171088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:57.171597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:57.172019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:57.172696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:57.173138 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:57.173547 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:57.315511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:57.323929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a7afa92a-ba37-4ef5-996e-8022f12db84b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.170040 Aug 24 11:14:57.324500 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 404/780] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:57 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:58.503788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:58.504474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:58.510701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:58.511219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:58.511643 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:58.512347 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:58.512867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:58.513538 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:58.651224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:58.662924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-71ea7c1b-3f32-48db-a5ae-653401309567 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.319195 Aug 24 11:14:58.663890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 377/781] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:58 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:14:59.687519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:14:59.688235 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:14:59.696777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:59.697445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:59.697873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:59.698720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:14:59.699538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:14:59.700232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:14:59.707214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:14:59.868857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:14:59.878704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1701b654-a71d-46b4-9136-7a208e201a40 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.197242 Aug 24 11:14:59.879306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 405/782] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:14:59 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:00.906884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:00.908089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:00.918577 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:00.920077 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:00.920524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:00.921218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:00.921685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:00.922102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:01.064502 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:01.072411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7c9a9230-ec27-40b2-a905-49fe1c3a73ed tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.173708 Aug 24 11:15:01.072982 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 378/783] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:00 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:02.095954 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:02.096613 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:02.104469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:02.105017 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:02.105523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:02.106318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:02.106941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:02.107691 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:02.267078 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:02.274914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4537a1ed-e868-4a8c-a2e7-0b94284ad225 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.183782 Aug 24 11:15:02.275847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 406/784] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:02 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:03.301405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:03.302340 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:03.313549 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:03.314294 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:03.315020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:03.316177 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:03.316905 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:03.317588 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:03.458343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:03.466580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-93fd40f3-c2d0-4402-9013-a0359ae0069d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.171811 Aug 24 11:15:03.467224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 379/785] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:03 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:04.487757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:04.488354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:04.494928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:04.495623 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:04.496066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:04.496788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:04.497293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:04.497798 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:04.640485 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:04.648211 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7fcab767-cfe1-4fc4-9f63-90daadbec56e tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.164344 Aug 24 11:15:04.648782 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 407/786] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:04 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:05.673160 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:05.673777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:05.681223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:05.681638 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:05.682064 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:05.682745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:05.683239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:05.683648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:05.818219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:05.828116 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2c9110e3-7a6d-4a40-9f74-d6d991e275dd tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1577 microversion: 2.1 time: 0.161035 Aug 24 11:15:05.828714 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 380/787] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:05 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:06.849847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:06.850482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:06.857037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:06.857487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:06.857917 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:06.858627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:06.859088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:06.859503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:06.933442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-71fb5b8a-42c4-496d-9fad-3b26b48d19f4 req-39d0f265-de8f-4f25-8613-1529b0161b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce", "name": "network-vif-plugged", "status": "completed", "tag": "2bd4251a-385e-4718-b6a2-35c629d4bbb6"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:06.944240 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-71fb5b8a-42c4-496d-9fad-3b26b48d19f4 req-39d0f265-de8f-4f25-8613-1529b0161b66 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:06.944714 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-71fb5b8a-42c4-496d-9fad-3b26b48d19f4 req-39d0f265-de8f-4f25-8613-1529b0161b66 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:06.945132 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-71fb5b8a-42c4-496d-9fad-3b26b48d19f4 req-39d0f265-de8f-4f25-8613-1529b0161b66 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:06.961772 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-71fb5b8a-42c4-496d-9fad-3b26b48d19f4 req-39d0f265-de8f-4f25-8613-1529b0161b66 service nova] Creating event network-vif-plugged:2bd4251a-385e-4718-b6a2-35c629d4bbb6 for instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce on hv-cinder-85427 Aug 24 11:15:06.966845 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-71fb5b8a-42c4-496d-9fad-3b26b48d19f4 req-39d0f265-de8f-4f25-8613-1529b0161b66 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037330 Aug 24 11:15:06.967811 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 381/788] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:15:07.007299 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:07.015741 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cca87a2c-38f2-47a7-b614-6b2c675fe547 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1564 microversion: 2.1 time: 0.169910 Aug 24 11:15:07.016308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 408/789] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:06 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:16.861235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:16.863572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:16.869887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:16.870357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:16.870769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:16.871469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:16.871904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:16.872311 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:16.901425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1e9e804f-8801-4a4b-ab3d-d9b67c95ab70 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045103 Aug 24 11:15:16.901961 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 382/790] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:16 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:15:16.975023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:16.975581 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:16.977992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:16.983401 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:16.983867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:16.984265 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:16.984972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:16.985410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:16.985811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:17.011627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:15:17.096302 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b92fe41b-6559-4f27-a28e-b1122f9e731e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 204 len: 0 microversion: 2.1 time: 0.124779 Aug 24 11:15:17.100062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 409/791] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:15:16 2022] DELETE /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:15:17.105245 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:17.105843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:17.112008 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:17.112494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:17.112922 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:17.113590 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:17.114034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:17.114443 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:17.247987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:17.255894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-546862a5-69f7-4d5c-81d1-37ea1537241a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1674 microversion: 2.1 time: 0.154480 Aug 24 11:15:17.256429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 383/792] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:17 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:18.282916 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:18.284100 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:18.294681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:18.295547 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:18.296250 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:18.297604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:18.298075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:18.298490 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:18.437777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:18.445613 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-15a8b820-50af-476c-8115-d9c7e5b54d4c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1674 microversion: 2.1 time: 0.169878 Aug 24 11:15:18.446176 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 410/793] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:18 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:19.467839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:19.468409 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:19.472148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=26 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:19.475035 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-6cfc3c52-8239-463c-9a8b-6c0224cdc4f9 req-08f18ca3-5f86-4ab8-907f-00acde7ff14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7140e32-0590-472a-a151-bd551fb262fe", "name": "network-vif-deleted", "tag": "da8a304b-8b4f-4b24-acb2-ae0932287926"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:19.478328 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.479275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.480071 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.481042 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.481848 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.482489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.500773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-6cfc3c52-8239-463c-9a8b-6c0224cdc4f9 req-08f18ca3-5f86-4ab8-907f-00acde7ff14a service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.504188 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-6cfc3c52-8239-463c-9a8b-6c0224cdc4f9 req-08f18ca3-5f86-4ab8-907f-00acde7ff14a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.505504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-6cfc3c52-8239-463c-9a8b-6c0224cdc4f9 req-08f18ca3-5f86-4ab8-907f-00acde7ff14a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.524474 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-6cfc3c52-8239-463c-9a8b-6c0224cdc4f9 req-08f18ca3-5f86-4ab8-907f-00acde7ff14a service nova] Creating event network-vif-deleted:da8a304b-8b4f-4b24-acb2-ae0932287926 for instance c7140e32-0590-472a-a151-bd551fb262fe on hv-cinder-85427 Aug 24 11:15:19.536153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-6cfc3c52-8239-463c-9a8b-6c0224cdc4f9 req-08f18ca3-5f86-4ab8-907f-00acde7ff14a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065201 Aug 24 11:15:19.536777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 411/794] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:19.557079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:19.566469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a674abc1-9f7f-4cf6-a594-93d05e90fd87 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 200 len: 1606 microversion: 2.1 time: 0.102677 Aug 24 11:15:19.580117 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 384/795] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:19 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 1606 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:19.699383 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:19.699959 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:19.707963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.708820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.709248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.709945 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.710421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.710840 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.794906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lazy-loading 'services' on Instance uuid ec7d6ae8-160f-49f0-ae59-b2986c77f579 {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:15:19.871523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2146071e-0f18-4c43-ab6f-7384986ec1d4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments/2cbb1772-65fe-46b8-99a1-3a158c460b39" status: 202 len: 0 microversion: 2.1 time: 0.176254 Aug 24 11:15:19.872442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 412/796] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:15:19 2022] DELETE /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments/2cbb1772-65fe-46b8-99a1-3a158c460b39 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:15:19.880832 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:19.883125 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:19.889350 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.890046 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.890467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.891198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:19.891729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:19.892188 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:19.922489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-43776041-4922-4d36-ac4b-1b0b224e01f4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Aug 24 11:15:19.927403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 385/797] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:19 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:20.589316 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:20.590067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:20.596537 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:20.597013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:20.597432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:20.598112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:20.598554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:20.598969 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:20.612432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] HTTP exception thrown: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Request method failure captured: Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe HTTP/1.1 Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZMk3NR_sexKwz-2gBaSftE9rFlvpuetTPgUqE5OkZk6yUJ7wbG0wVwMpdGxrBZYqYaOgigY0W1BhJ8uPmPRCw_i864x7ksGUkD2xV1oopQcuGZjDqRBmAn5edordmL3V0MaTdeEo7dzy-7-vlk9d8Xf-rFD91zF1ABVaInXGii0rM Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:15:20.614079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_808dbefab4f0467c8f6ff0f18453d0b0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 28b3ce054ae04f8e9db0cdc3a13867e9 Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:15:20.615658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'c7140e32-0590-472a-a151-bd551fb262fe'} Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:15:20.616555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:15:20.618215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:20.619821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Returning 404 to user: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:15:20.619821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ac4c2524-cca2-47fd-8856-2c468156797d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 404 len: 111 microversion: 2.1 time: 0.031081 Aug 24 11:15:20.619821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 413/798] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:20 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:15:20.625261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d7dc4720-352e-493d-ad86-665464e5b71b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '.version_select at 0x7f82baa4c1f0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:20.653392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d7dc4720-352e-493d-ad86-665464e5b71b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708317411" status: 202 len: 0 microversion: 2.1 time: 0.032087 Aug 24 11:15:20.653966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 386/799] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 24 11:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708317411 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:15:20.935143 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:20.937455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:20.944833 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:20.945309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:20.945746 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:20.946429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:20.946870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:20.947335 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:20.979601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3b5387f9-139c-4824-9c2c-1b93a9bb772d tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048449 Aug 24 11:15:20.980157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 414/800] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:15:20 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:15:21.057724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:21.058217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:21.064767 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:21.065250 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:21.065682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:21.066379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:21.066830 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:21.067281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:21.093106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:15:21.175513 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-20de03fe-d94e-41b4-9ffe-71690d17436f tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 204 len: 0 microversion: 2.1 time: 0.121982 Aug 24 11:15:21.179308 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 387/801] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:15:21 2022] DELETE /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:15:21.184565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:21.185163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:21.191835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:21.192354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:21.192998 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:21.193742 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:21.194142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:21.194581 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:21.323021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4c869cd6-ae55-4b1d-b11a-07629641c50a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'create', calling method: .version_select at 0x7f82baa4cb80>, body: {"keypair": {"name": "tempest-keypair-642138192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7JkCFY8X2ujgK34j9LZDGUKTIEh88iZVPcbHlyIwaNzmOdyG06htqoRgAmTSSrdKIjUcdUxLmD4+wEBgZVqhrGJVmztBcF6VnANwNUL/28X6+G4+HkCagSR4fWdxSCzQ=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:21.336723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:21.338779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-4c869cd6-ae55-4b1d-b11a-07629641c50a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:15:21.342845 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-4c869cd6-ae55-4b1d-b11a-07629641c50a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for user 28b3ce054ae04f8e9db0cdc3a13867e9 and project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:15:21.352690 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-836ab53d-4b77-4c7a-a5fb-6277fe52207e tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1691 microversion: 2.1 time: 0.171738 Aug 24 11:15:21.353215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 415/802] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:21 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:15:21.366219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4c869cd6-ae55-4b1d-b11a-07629641c50a tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047431 Aug 24 11:15:21.366812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 388/803] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:15:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:22.373392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:22.373995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:22.381159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:22.381637 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:22.382064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:22.382757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:22.383214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:22.383627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:22.587461 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:22.599217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5266a871-af39-4430-b6d2-faa46ad3892c tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1691 microversion: 2.1 time: 0.230027 Aug 24 11:15:22.600004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 416/804] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:22 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:22.799311 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1918707289", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c40a07f-d287-4976-935d-2900a6918b41"}], "security_groups": [{"name": "tempest-securitygroup--224105570"}], "key_name": "tempest-keypair-642138192", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:22.917012 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] validate_networks() for [('0c40a07f-d287-4976-935d-2900a6918b41', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:15:23.314636 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:15:23.315297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:15:23.315978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:15:23.316635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:15:23.317226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:15:23.330729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:23.331238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:23.331661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:23.332372 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:23.332817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:23.333235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:23.338751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:23.353424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:15:23.357937 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Getting quotas for user 28b3ce054ae04f8e9db0cdc3a13867e9 and project 808dbefab4f0467c8f6ff0f18453d0b0. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:15:23.369764 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:15:23.372153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:15:23.421088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b6e1001c-906b-467e-88e5-1f07e8fffc67 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.628166 Aug 24 11:15:23.422058 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 389/805] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:15:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:15:23.433470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3ba76626-b9ee-443f-88ba-3badda086fd8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:23.434067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3ba76626-b9ee-443f-88ba-3badda086fd8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:23.487125 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3ba76626-b9ee-443f-88ba-3badda086fd8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:23.493947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3ba76626-b9ee-443f-88ba-3badda086fd8 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1237 microversion: 2.1 time: 0.064455 Aug 24 11:15:23.494513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 417/806] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:23 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:23.624265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:23.625299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:23.631929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:23.632596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:23.633204 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:23.633878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:23.634518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:23.635172 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:23.789648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:23.798641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8be75c3e-243c-424f-9e91-45ad06707a61 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1691 microversion: 2.1 time: 0.178239 Aug 24 11:15:23.799189 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 390/807] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:23 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:24.518794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:24.520146 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:24.531924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:24.532417 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:24.532833 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:24.533508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:24.533946 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:24.534353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:24.605046 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:24.613158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-483d51e8-ef41-4b6c-9948-988290f56220 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1289 microversion: 2.1 time: 0.100782 Aug 24 11:15:24.613927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 418/808] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:24 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:24.820683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:24.821325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:24.828105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:24.828655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:24.829589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:24.830282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:24.830952 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:24.831216 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:24.963586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:24.971900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-440c95f7-eb90-49d8-856a-8b0b5a211206 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1691 microversion: 2.1 time: 0.155421 Aug 24 11:15:24.986087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 391/809] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:24 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:25.634175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:25.634841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:25.641764 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:25.642346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:25.642771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:25.643470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:25.643908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:25.644321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:25.709771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:25.717311 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a663889c-f7b7-4315-a1db-22266441602c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1295 microversion: 2.1 time: 0.087120 Aug 24 11:15:25.718072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 419/810] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:25 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:25.992626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:25.994746 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:26.004872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:26.005826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:26.006504 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:26.008472 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:26.009576 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:26.011024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:26.054656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-c8f81c6f-f50f-42d8-933f-552b3a86186c req-d4460195-f1a5-4f22-a3f4-4929571ceb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec7d6ae8-160f-49f0-ae59-b2986c77f579", "name": "network-vif-deleted", "tag": "5263f317-1ef6-49d4-bae2-2c20bcd761f0"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:26.065520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-c8f81c6f-f50f-42d8-933f-552b3a86186c req-d4460195-f1a5-4f22-a3f4-4929571ceb83 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:26.073173 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-c8f81c6f-f50f-42d8-933f-552b3a86186c req-d4460195-f1a5-4f22-a3f4-4929571ceb83 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:26.073626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-c8f81c6f-f50f-42d8-933f-552b3a86186c req-d4460195-f1a5-4f22-a3f4-4929571ceb83 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:26.099619 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-c8f81c6f-f50f-42d8-933f-552b3a86186c req-d4460195-f1a5-4f22-a3f4-4929571ceb83 service nova] Creating event network-vif-deleted:5263f317-1ef6-49d4-bae2-2c20bcd761f0 for instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 on hv-cinder-85427 Aug 24 11:15:26.144857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-c8f81c6f-f50f-42d8-933f-552b3a86186c req-d4460195-f1a5-4f22-a3f4-4929571ceb83 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095536 Aug 24 11:15:26.147616 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 420/811] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:26.158270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:26.168092 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fbd17461-be8a-465e-8585-03e40cd83b74 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 200 len: 1623 microversion: 2.1 time: 0.178461 Aug 24 11:15:26.169217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 392/812] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:25 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 1623 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:26.739171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:26.739857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:26.747000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:26.747505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:26.747930 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:26.748618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:26.749240 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:26.749655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:26.905408 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:26.914859 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-568510d9-9c71-4105-b094-1f0d32ed1c48 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1362 microversion: 2.1 time: 0.180290 Aug 24 11:15:26.922941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 421/813] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:26 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:27.192054 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:27.193257 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: ec7d6ae8-160f-49f0-ae59-b2986c77f579] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:27.200388 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:27.200977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:27.201652 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:27.202574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:27.203517 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:27.204170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:27.224694 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] HTTP exception thrown: Instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 could not be found. Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Request method failure captured: Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 HTTP/1.1 Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZNTWI46EyWOVthpnrkpQbS04WegfQ-JCzszT53sEwlXHpfW8PBTRCrT4o6AmA1pbqg-yl54Vcrv1zn938p0u8pmb_DzHMe6n-Og-swCi7u1baTQpfDPBYLvWWiCbrZMMCuXPfwEwrOKYrhsSgRP_13YhN_GvDbhsgWI1W6c2dc6K4 Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:15:27.226356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18b9988b1131422f9db644695c1df22d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18b9988b1131422f9db644695c1df22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: e808c04cd77d446ca2c05712868b7ce3 Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 could not be found. Aug 24 11:15:27.228140 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'ec7d6ae8-160f-49f0-ae59-b2986c77f579'} Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 could not be found. Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:15:27.229102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 could not be found. Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 could not be found. Aug 24 11:15:27.230589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:27.231867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Returning 404 to user: Instance ec7d6ae8-160f-49f0-ae59-b2986c77f579 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:15:27.231867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f8846179-2183-4cbc-ad48-63c4a2c495fa tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579" status: 404 len: 111 microversion: 2.1 time: 0.041425 Aug 24 11:15:27.231867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 393/814] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:27 2022] GET /compute/v2.1/servers/ec7d6ae8-160f-49f0-ae59-b2986c77f579 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:15:27.238451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0d0377d2-bcfd-43af-b782-f2b3c6d495f8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '.version_select at 0x7f82b6176790>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:27.264903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0d0377d2-bcfd-43af-b782-f2b3c6d495f8 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817095688" status: 202 len: 0 microversion: 2.1 time: 0.030967 Aug 24 11:15:27.269318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 422/815] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 24 11:15:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817095688 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:15:27.936500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:27.937403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:27.943497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:27.944032 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:27.944523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:27.945293 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:27.945729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:27.946133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:28.085430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:28.096315 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d42b2f0e-b71d-42c7-9370-0d33b1a8f945 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1362 microversion: 2.1 time: 0.163659 Aug 24 11:15:28.096895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 394/816] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:27 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:28.196163 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-43635e6f-e8f5-4cff-91fc-d51a78cd997d req-ae598bf3-5006-4063-9c5b-6b4a111da64b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc62ce05-f502-46d7-8979-1e1c372c157b", "tag": "2ee675a8-84a6-480a-b02e-1e92a55084ba"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:28.206909 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-43635e6f-e8f5-4cff-91fc-d51a78cd997d req-ae598bf3-5006-4063-9c5b-6b4a111da64b service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:28.207418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-43635e6f-e8f5-4cff-91fc-d51a78cd997d req-ae598bf3-5006-4063-9c5b-6b4a111da64b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:28.207844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-43635e6f-e8f5-4cff-91fc-d51a78cd997d req-ae598bf3-5006-4063-9c5b-6b4a111da64b service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:28.218642 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-43635e6f-e8f5-4cff-91fc-d51a78cd997d req-ae598bf3-5006-4063-9c5b-6b4a111da64b service nova] Creating event network-changed:2ee675a8-84a6-480a-b02e-1e92a55084ba for instance bc62ce05-f502-46d7-8979-1e1c372c157b on hv-cinder-85427 Aug 24 11:15:28.224314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-43635e6f-e8f5-4cff-91fc-d51a78cd997d req-ae598bf3-5006-4063-9c5b-6b4a111da64b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032420 Aug 24 11:15:28.224885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 423/817] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:29.119847 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:29.121558 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:29.129819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:29.130729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:29.131198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:29.131899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:29.132350 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:29.132767 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:29.277787 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:29.285897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8782d3ba-d037-4b9a-9298-5385b3db4d00 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1362 microversion: 2.1 time: 0.171920 Aug 24 11:15:29.286373 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 395/818] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:29 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:30.213421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:30.213950 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:30.223153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:30.223630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:30.224058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.224811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:30.225265 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:30.225682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.228425 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:30.258934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:15:30.307665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:30.308301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:30.315241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:30.315723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:30.316118 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.316995 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:30.317751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:30.318167 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.349637 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c229b844-ea3c-4223-8cab-5580bb97b53b tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 204 len: 0 microversion: 2.1 time: 0.140902 Aug 24 11:15:30.351633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 424/819] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:15:30 2022] DELETE /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:15:30.362555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:30.363655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:30.370963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:30.371634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:30.372615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.373670 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:30.374117 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:30.374529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:30.501207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:30.509327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-66fd5b38-640e-4dc2-9493-ec98fa052f75 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1362 microversion: 2.1 time: 0.206073 Aug 24 11:15:30.510013 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 396/820] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:30 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:30.540278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:30.552724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-76bf2ab4-0574-41a0-8cec-27527c5c6a88 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1508 microversion: 2.1 time: 0.195596 Aug 24 11:15:30.553362 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 425/821] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:30 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:15:31.530842 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:31.531546 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:31.539812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.540099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-9320455f-dd35-4f22-a516-3f8ab836801a req-57f95698-3d4b-479a-be8f-946c98acbfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4f034f-a8a6-47f5-a6a6-f420a528333f", "name": "network-vif-deleted", "tag": "1bc718d7-7c18-4093-b2ae-95110a425a49"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:31.540556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.540786 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.542515 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.542969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.543432 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.550318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9320455f-dd35-4f22-a516-3f8ab836801a req-57f95698-3d4b-479a-be8f-946c98acbfda service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.551153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9320455f-dd35-4f22-a516-3f8ab836801a req-57f95698-3d4b-479a-be8f-946c98acbfda service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.551826 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9320455f-dd35-4f22-a516-3f8ab836801a req-57f95698-3d4b-479a-be8f-946c98acbfda service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.564005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-9320455f-dd35-4f22-a516-3f8ab836801a req-57f95698-3d4b-479a-be8f-946c98acbfda service nova] Creating event network-vif-deleted:1bc718d7-7c18-4093-b2ae-95110a425a49 for instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f on hv-cinder-85427 Aug 24 11:15:31.571807 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-9320455f-dd35-4f22-a516-3f8ab836801a req-57f95698-3d4b-479a-be8f-946c98acbfda service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035526 Aug 24 11:15:31.572810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 426/822] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:31.579523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:31.580432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:31.586996 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.587786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.588442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.589138 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:31.589673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:31.590099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:31.674581 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:31.683862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a122eee9-6a3f-48b6-81e8-56fc97d8d60a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 200 len: 1293 microversion: 2.1 time: 0.109486 Aug 24 11:15:31.684650 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 427/823] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:31 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:31.735618 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:31.744001 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bbe931ad-71e6-426c-9ea0-46432c64eb59 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1362 microversion: 2.1 time: 0.216858 Aug 24 11:15:31.744505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 397/824] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:31 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:32.707800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:32.708655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: 2c4f034f-a8a6-47f5-a6a6-f420a528333f] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:32.718256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.719006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.719464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.720158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.720769 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.721217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.735435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] HTTP exception thrown: Instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f could not be found. Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Request method failure captured: Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f HTTP/1.1 Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZNTWI46EyWOVthpnrkpQbS04WegfQ-JCzszT53sEwlXHpfW8PBTRCrT4o6AmA1pbqg-yl54Vcrv1zn938p0u8pmb_DzHMe6n-Og-swCi7u1baTQpfDPBYLvWWiCbrZMMCuXPfwEwrOKYrhsSgRP_13YhN_GvDbhsgWI1W6c2dc6K4 Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:15:32.737084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18b9988b1131422f9db644695c1df22d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18b9988b1131422f9db644695c1df22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: e808c04cd77d446ca2c05712868b7ce3 Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f could not be found. Aug 24 11:15:32.738632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '2c4f034f-a8a6-47f5-a6a6-f420a528333f'} Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f could not be found. Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:15:32.739877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f could not be found. Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f could not be found. Aug 24 11:15:32.741246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:32.742652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Returning 404 to user: Instance 2c4f034f-a8a6-47f5-a6a6-f420a528333f could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:15:32.742652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d14eb5e4-b62e-4310-8fe3-6e7a0fe94b15 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f" status: 404 len: 111 microversion: 2.1 time: 0.036356 Aug 24 11:15:32.742652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 428/825] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:32 2022] GET /compute/v2.1/servers/2c4f034f-a8a6-47f5-a6a6-f420a528333f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:15:32.747144 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:32.747649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:32.754207 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.754681 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.755123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.755823 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.756249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.756663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.764595 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:32.765195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:32.771820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.772297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.772724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.773410 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.773844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.775141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.782063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:15:32.864100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5bdefc38-85e7-4b28-8fb2-c101d56d6948 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 204 len: 0 microversion: 2.1 time: 0.120513 Aug 24 11:15:32.864701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 398/826] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:15:32 2022] DELETE /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:15:32.874663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:32.875500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:32.881493 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.881977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.882405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.883145 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:32.883589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:32.884005 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:32.910615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:32.918596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c84c6525-7033-4fc4-9d78-05d07cd8a872 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1362 microversion: 2.1 time: 0.157794 Aug 24 11:15:32.919479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 429/827] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:32 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:33.077500 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-bba4f43b-1fcd-4582-a61c-ce49f2c55dbc req-408db566-b66f-456a-b163-315813418b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc62ce05-f502-46d7-8979-1e1c372c157b", "name": "network-vif-plugged", "status": "completed", "tag": "2ee675a8-84a6-480a-b02e-1e92a55084ba"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:33.087627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-bba4f43b-1fcd-4582-a61c-ce49f2c55dbc req-408db566-b66f-456a-b163-315813418b2e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:33.088100 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-bba4f43b-1fcd-4582-a61c-ce49f2c55dbc req-408db566-b66f-456a-b163-315813418b2e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:33.088527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-bba4f43b-1fcd-4582-a61c-ce49f2c55dbc req-408db566-b66f-456a-b163-315813418b2e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:33.106556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-bba4f43b-1fcd-4582-a61c-ce49f2c55dbc req-408db566-b66f-456a-b163-315813418b2e service nova] Creating event network-vif-plugged:2ee675a8-84a6-480a-b02e-1e92a55084ba for instance bc62ce05-f502-46d7-8979-1e1c372c157b on hv-cinder-85427 Aug 24 11:15:33.116792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-bba4f43b-1fcd-4582-a61c-ce49f2c55dbc req-408db566-b66f-456a-b163-315813418b2e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043025 Aug 24 11:15:33.117657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 430/828] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:33.207183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:33.215678 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-946f10ba-c21e-4f52-97f9-1030fff2522a tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1522 microversion: 2.1 time: 0.346296 Aug 24 11:15:33.216246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 399/829] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:32 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:33.937995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:33.945064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:33.946131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:33.957021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:33.957021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:33.957021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:33.957021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:33.959987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:33.959987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:34.090295 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:34.098291 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5a946907-d41f-4008-8329-65d3886a737c tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1362 microversion: 2.1 time: 0.161574 Aug 24 11:15:34.098971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 431/830] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:33 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:34.241327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:34.245428 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:34.247567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:34.248215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=10 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:34.257844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:34.258331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:34.258766 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:34.259486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:34.259926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:34.260342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:34.291363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-dfd8a0a1-839d-4d6c-a441-9d2948f90293 req-1c11c47a-6efc-46bb-a6a7-50d595013e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02fe8ce-b37d-4d03-a1b1-3b434850514d", "name": "network-vif-deleted", "tag": "3eb1fd1c-0294-4966-b482-f9a4c66d814b"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:34.301556 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-dfd8a0a1-839d-4d6c-a441-9d2948f90293 req-1c11c47a-6efc-46bb-a6a7-50d595013e55 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:34.302122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-dfd8a0a1-839d-4d6c-a441-9d2948f90293 req-1c11c47a-6efc-46bb-a6a7-50d595013e55 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:34.302536 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-dfd8a0a1-839d-4d6c-a441-9d2948f90293 req-1c11c47a-6efc-46bb-a6a7-50d595013e55 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:34.313762 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-dfd8a0a1-839d-4d6c-a441-9d2948f90293 req-1c11c47a-6efc-46bb-a6a7-50d595013e55 service nova] Creating event network-vif-deleted:3eb1fd1c-0294-4966-b482-f9a4c66d814b for instance e02fe8ce-b37d-4d03-a1b1-3b434850514d on hv-cinder-85427 Aug 24 11:15:34.319364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-dfd8a0a1-839d-4d6c-a441-9d2948f90293 req-1c11c47a-6efc-46bb-a6a7-50d595013e55 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031228 Aug 24 11:15:34.319951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 432/831] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:15:34.329480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e808c04cd77d446ca2c05712868b7ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9988b1131422f9db644695c1df22d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:34.337196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1b4528e8-a5c2-4e0a-9101-77a7fc9ef8ee tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 200 len: 1480 microversion: 2.1 time: 0.103970 Aug 24 11:15:34.337774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 400/832] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:34 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 1480 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:35.121943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:35.122872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:35.130578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:35.131403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:35.131822 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:35.132489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:35.132931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:35.133320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:35.270457 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:35.279344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-866ded9b-e9ea-4f69-ba59-40b48ba6249b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1547 microversion: 2.1 time: 0.162912 Aug 24 11:15:35.279895 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 433/833] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:35 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:15:35.301335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:35.302162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:35.309352 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:35.309859 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:35.310276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:35.310944 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:35.311595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:35.312005 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:35.357956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:35.358824 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] [instance: e02fe8ce-b37d-4d03-a1b1-3b434850514d] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:35.366004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:35.366540 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:35.366954 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:35.367674 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:35.368128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:35.368631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:35.383587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] HTTP exception thrown: Instance e02fe8ce-b37d-4d03-a1b1-3b434850514d could not be found. Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Request method failure captured: Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d HTTP/1.1 Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZNTWI46EyWOVthpnrkpQbS04WegfQ-JCzszT53sEwlXHpfW8PBTRCrT4o6AmA1pbqg-yl54Vcrv1zn938p0u8pmb_DzHMe6n-Og-swCi7u1baTQpfDPBYLvWWiCbrZMMCuXPfwEwrOKYrhsSgRP_13YhN_GvDbhsgWI1W6c2dc6K4 Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:15:35.385192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18b9988b1131422f9db644695c1df22d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18b9988b1131422f9db644695c1df22d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18b9988b1131422f9db644695c1df22d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 18b9988b1131422f9db644695c1df22d Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-113764197 Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: e808c04cd77d446ca2c05712868b7ce3 Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-ServerRescueNegativeTestJSON-113764197-project Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance e02fe8ce-b37d-4d03-a1b1-3b434850514d could not be found. Aug 24 11:15:35.386626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'e02fe8ce-b37d-4d03-a1b1-3b434850514d'} Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02fe8ce-b37d-4d03-a1b1-3b434850514d could not be found. Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:15:35.387424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02fe8ce-b37d-4d03-a1b1-3b434850514d could not be found. Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02fe8ce-b37d-4d03-a1b1-3b434850514d could not be found. Aug 24 11:15:35.388749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:15:35.390618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] Returning 404 to user: Instance e02fe8ce-b37d-4d03-a1b1-3b434850514d could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:15:35.390618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-81aa1d3a-8375-497b-b41d-d1d7376e31b4 tempest-ServerRescueNegativeTestJSON-113764197 tempest-ServerRescueNegativeTestJSON-113764197-project] 10.222.0.79 "GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d" status: 404 len: 111 microversion: 2.1 time: 0.032551 Aug 24 11:15:35.390618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 434/834] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:15:35 2022] GET /compute/v2.1/servers/e02fe8ce-b37d-4d03-a1b1-3b434850514d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:15:35.394446 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-db7af995-9536-4849-99f1-cde00bee79df tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097029 Aug 24 11:15:35.395021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 401/835] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:15:35 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:37.198182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-c47690ca-fffa-4d8d-9472-fec4b15d6fc2 req-f7243223-890b-409b-bcbf-13004882c47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc62ce05-f502-46d7-8979-1e1c372c157b", "tag": "2ee675a8-84a6-480a-b02e-1e92a55084ba"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:37.212577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-c47690ca-fffa-4d8d-9472-fec4b15d6fc2 req-f7243223-890b-409b-bcbf-13004882c47a service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:37.213047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-c47690ca-fffa-4d8d-9472-fec4b15d6fc2 req-f7243223-890b-409b-bcbf-13004882c47a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:37.213643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-c47690ca-fffa-4d8d-9472-fec4b15d6fc2 req-f7243223-890b-409b-bcbf-13004882c47a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:37.225921 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-c47690ca-fffa-4d8d-9472-fec4b15d6fc2 req-f7243223-890b-409b-bcbf-13004882c47a service nova] Creating event network-changed:2ee675a8-84a6-480a-b02e-1e92a55084ba for instance bc62ce05-f502-46d7-8979-1e1c372c157b on hv-cinder-85427 Aug 24 11:15:37.230703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-c47690ca-fffa-4d8d-9472-fec4b15d6fc2 req-f7243223-890b-409b-bcbf-13004882c47a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036560 Aug 24 11:15:37.231596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 435/836] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:41.593075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d78449b1-eb74-4e92-b089-20d58d246af7 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Action: 'create', calling method: .version_select at 0x7f82baac9a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1164657251", "metadata": {"Type": "work"}}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:41.909130 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d78449b1-eb74-4e92-b089-20d58d246af7 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.439622 Aug 24 11:15:41.909740 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 402/837] 10.222.0.79 () {60 vars in 1156 bytes} [Wed Aug 24 11:15:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 441 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 11:15:41.923214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fc8f727b-807d-4ec2-8ad6-b08835ad17a6 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Calling method '.version_select at 0x7f82b624d1f0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:41.972718 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fc8f727b-807d-4ec2-8ad6-b08835ad17a6 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb" status: 200 len: 353 microversion: 2.1 time: 0.054389 Aug 24 11:15:41.973389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 436/838] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:15:41 2022] GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:42.989434 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c2e0f7f3-6360-4cb6-8cd4-a6a82b553348 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Calling method '.version_select at 0x7f82bab2e3a0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:43.044180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c2e0f7f3-6360-4cb6-8cd4-a6a82b553348 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb" status: 200 len: 354 microversion: 2.1 time: 0.060389 Aug 24 11:15:43.044800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 403/839] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:15:42 2022] GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:43.057064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a71d980b-0b6d-44fd-bffa-6a367adc165d tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Calling method '.version_select at 0x7f82b62e20d0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:43.104332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a71d980b-0b6d-44fd-bffa-6a367adc165d tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb" status: 200 len: 354 microversion: 2.1 time: 0.050916 Aug 24 11:15:43.104904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 437/840] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:15:43 2022] GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:43.129146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4b50f1eb-6d67-4d64-bad4-9e1e1f017967 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Calling method '.version_select at 0x7f82bab2eca0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:43.197414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4b50f1eb-6d67-4d64-bad4-9e1e1f017967 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb" status: 202 len: 0 microversion: 2.1 time: 0.072630 Aug 24 11:15:43.198333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 404/841] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:15:43 2022] DELETE /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:15:43.206388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9b9a5d34-c90d-49f8-8b75-039f7493d6fc tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Calling method '.version_select at 0x7f82b6176160>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:43.256087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9b9a5d34-c90d-49f8-8b75-039f7493d6fc tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb" status: 200 len: 353 microversion: 2.1 time: 0.053179 Aug 24 11:15:43.256864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 438/842] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:15:43 2022] GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:15:44.276643 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bf3a32c3-2196-4859-abff-1307f6bcb553 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Calling method '.version_select at 0x7f82baaa61f0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:44.309840 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-bf3a32c3-2196-4859-abff-1307f6bcb553 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] HTTP exception thrown: Volume 75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb could not be found. Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bf3a32c3-2196-4859-abff-1307f6bcb553 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Request method failure captured: Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb HTTP/1.1 Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBghdBA4fK9tQdfbOP2rX9OXxJerFv4OplFLj2j7DuE2KlNaRBET5c1wyldGDjAAyUbvi-eF_kMyJ9QT6NWBd0IirN0AkXGprNubxMfyD6v14nPP0WNPIdWG0_w4TIqPsOHTlcostoHWtwod-5Q2Hv1XT2RPdZ-jf-MirTK3Dt3VPp9Q Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 7caead177d604c969582f2405bc751e1 Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesGetTestJSON-724670733 Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:15:44.311928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7caead177d604c969582f2405bc751e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7caead177d604c969582f2405bc751e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7caead177d604c969582f2405bc751e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7caead177d604c969582f2405bc751e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesGetTestJSON-724670733 Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 7caead177d604c969582f2405bc751e1 Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesGetTestJSON-724670733 Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesGetTestJSON-724670733-project Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 2b3d99a03eac48169d04ef908ae6f4bc Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesGetTestJSON-724670733-project Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Volume 75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb could not be found. Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb'} Aug 24 11:15:44.313510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb could not be found. (HTTP 404) (Request-ID: req-77900d96-75b5-4219-9693-5929292c710c) Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:44.314723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:15:44.316041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb could not be found. Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:15:44.317335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb could not be found. Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb could not be found. Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bf3a32c3-2196-4859-abff-1307f6bcb553 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] Returning 404 to user: Volume 75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bf3a32c3-2196-4859-abff-1307f6bcb553 tempest-VolumesGetTestJSON-724670733 tempest-VolumesGetTestJSON-724670733-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb" status: 404 len: 109 microversion: 2.1 time: 0.043226 Aug 24 11:15:44.318682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 405/843] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:15:44 2022] GET /compute/v2.1/os-volumes/75323c3a-ed26-4c12-a8b7-d7a6c24ed7bb => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:15:52.763832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:52.764570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:52.769102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:52.769686 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:52.777739 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:52.778217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:52.778790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:52.779700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:52.780134 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:52.780709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:52.805303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-59007ab0-fdc1-47a5-85df-a023cff64846 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/ips" status: 200 len: 153 microversion: 2.20 time: 0.042984 Aug 24 11:15:52.805877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 439/844] 10.222.0.79 () {60 vars in 1289 bytes} [Wed Aug 24 11:15:52 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:15:55.103077 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:55.103825 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:15:55.108534 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:15:55.109037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:55.116755 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:55.117490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:55.117932 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:55.118643 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:55.119106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:55.119518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:55.146282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lazy-loading 'flavor' on Instance uuid a12fb1be-eff8-42a1-9818-6cf5681c6917 {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:15:55.330248 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7b6319d5-cef2-40ad-903d-754a11ce2fc9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/action" status: 202 len: 0 microversion: 2.20 time: 0.228255 Aug 24 11:15:55.334735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 406/845] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 24 11:15:55 2022] POST /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:15:55.340191 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:55.341407 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:55.349374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:55.349927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:55.350417 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:55.351445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:55.352045 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:55.352463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:55.496158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:55.504776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:55.506259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:55.507414 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-55d962c9-ba2f-4f70-9c92-b04db48e4d5a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.171260 Aug 24 11:15:55.508342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 440/846] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:15:55 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:15:56.531886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:56.532952 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:56.540178 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:56.540654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:56.541075 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:56.541748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:56.542187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:56.542598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:56.678718 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:56.687153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:56.688633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:56.689878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ffaf26a3-f3ac-45f8-98e8-4ee0979c8e5b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.162890 Aug 24 11:15:56.691088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 407/847] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:15:56 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:15:57.713231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:57.713827 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:57.720492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:57.720968 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:57.721588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:57.722271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:57.722710 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:57.723142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:57.872179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:57.884185 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:57.886503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:57.888215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5a57cdfa-7d58-4442-ba41-a449f4eb498a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.179164 Aug 24 11:15:57.888873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 441/848] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:15:57 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:15:58.913395 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:58.913999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:15:58.921286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:58.921764 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:58.922192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:58.922882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:58.923356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:58.923775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:59.068789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:59.077287 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:59.078785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:15:59.079969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b29c206f-fc6a-4693-a3b3-1d7fdf2f8329 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.170678 Aug 24 11:15:59.080518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 408/849] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:15:58 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:00.104748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:00.105386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:00.112267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:00.112755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:00.113329 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:00.114019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:00.114460 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:00.114869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:00.265496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:00.278722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:00.280333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:00.281652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-08d1bc6a-0f73-43a1-abf1-9faac61afc91 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.180852 Aug 24 11:16:00.282207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 442/850] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:00 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:01.306242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:01.306874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:01.313926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:01.314405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:01.314818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:01.315665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:01.316106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:01.316515 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:01.452708 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:01.461523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:01.463023 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:01.464267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-583a6f4f-a1b2-4de8-8243-c544bb04dde9 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.161970 Aug 24 11:16:01.464815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 409/851] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:01 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:02.487928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:02.488564 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:02.495673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:02.496148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:02.496564 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:02.497252 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:02.497684 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:02.498094 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:02.639505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:02.648056 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:02.649876 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:02.651034 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ceb84569-6b7d-4b5d-b0b2-1d2284875fdd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.167084 Aug 24 11:16:02.651622 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 443/852] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:02 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:03.674068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:03.674674 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:03.682112 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:03.682632 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:03.683016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:03.683878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:03.684446 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:03.684844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:03.827077 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:03.836393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:03.837883 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:03.839193 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d046797e-ed42-414d-a893-cb514baf3cfe tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.169027 Aug 24 11:16:03.839788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 410/853] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:03 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:04.863938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:04.864508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:04.874024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:04.874673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:04.875207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:04.876216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:04.876827 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:04.877281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:05.022251 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:05.031817 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:05.033330 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:05.034516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fa1dfbff-4bde-4528-8cc0-ba267e56e5af tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.175850 Aug 24 11:16:05.035281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 444/854] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:04 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:06.059028 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:06.059749 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:06.067345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:06.067829 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:06.068259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:06.068957 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:06.069404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:06.069824 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:06.208474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:06.217073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:06.218585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:06.219958 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e6bf0c12-e77e-42a2-936a-a88acb948c46 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.165003 Aug 24 11:16:06.220475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 411/855] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:06 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:07.248028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:07.248028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:07.252160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:07.252785 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:07.253208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:07.253887 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:07.254377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:07.254788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:07.391232 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:07.400110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:07.401639 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:07.402799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-741808eb-e505-4cc4-bba3-404de721ee79 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1747 microversion: 2.20 time: 0.162796 Aug 24 11:16:07.403610 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 445/856] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:07 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:08.430323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:08.431330 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:08.442245 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:08.443100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:08.443808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:08.445106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:08.445569 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:08.445990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:08.597260 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:08.606559 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:08.608120 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:08.609281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2ac13180-edf2-4de6-9109-905f596a5325 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1747 microversion: 2.20 time: 0.185959 Aug 24 11:16:08.609835 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 412/857] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:08 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1747 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:09.325786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-8802f919-0b77-4208-a714-b6a23c4c36ab req-ad3d1532-9763-4e17-9926-c828ae5a284a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12fb1be-eff8-42a1-9818-6cf5681c6917", "name": "network-vif-plugged", "status": "completed", "tag": "db943507-5258-4e45-8aaa-0ce5bc112e88"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:09.337356 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8802f919-0b77-4208-a714-b6a23c4c36ab req-ad3d1532-9763-4e17-9926-c828ae5a284a service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:09.337831 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8802f919-0b77-4208-a714-b6a23c4c36ab req-ad3d1532-9763-4e17-9926-c828ae5a284a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:09.338254 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8802f919-0b77-4208-a714-b6a23c4c36ab req-ad3d1532-9763-4e17-9926-c828ae5a284a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:09.349994 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-8802f919-0b77-4208-a714-b6a23c4c36ab req-ad3d1532-9763-4e17-9926-c828ae5a284a service nova] Creating event network-vif-plugged:db943507-5258-4e45-8aaa-0ce5bc112e88 for instance a12fb1be-eff8-42a1-9818-6cf5681c6917 on hv-cinder-85427 Aug 24 11:16:09.356483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-8802f919-0b77-4208-a714-b6a23c4c36ab req-ad3d1532-9763-4e17-9926-c828ae5a284a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034300 Aug 24 11:16:09.357069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 446/858] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:09.644066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:09.645026 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:09.653346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:09.653816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:09.654235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:09.654911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:09.655379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:09.655787 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:09.796875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:09.805615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:09.807132 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:09.808303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a6eb2667-1265-4118-a095-c771a087fd95 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1747 microversion: 2.20 time: 0.170717 Aug 24 11:16:09.808858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 413/859] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:09 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1747 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:10.832428 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:10.833048 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:10.839931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:10.840397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:10.840814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:10.841486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:10.841903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:10.842309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:10.980626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:10.989093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:10.990523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:10.991820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e2bb4668-1725-410d-b534-3d9df03ee166 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1747 microversion: 2.20 time: 0.164446 Aug 24 11:16:10.992538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 447/860] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:10 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:16:12.018622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:12.019601 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:12.028223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:12.028702 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:12.029129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:12.029814 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:12.030261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:12.030710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:12.169714 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:12.182524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:12.184915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:12.186585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c810cc51-0553-4a5d-a618-7b060b276284 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1747 microversion: 2.20 time: 0.174204 Aug 24 11:16:12.187409 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 414/861] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:12 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:13.210222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:13.210902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:13.218031 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:13.218531 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:13.218947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:13.219652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:13.220092 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:13.220564 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:13.354937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:13.363131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:13.364677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:13.365815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-acccd019-aa1f-4c2d-ab0f-c82cb52c57cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1747 microversion: 2.20 time: 0.159595 Aug 24 11:16:13.366368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 448/862] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:13 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:14.394331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:14.396338 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:14.404520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:14.405004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:14.405740 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:14.406696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:14.407397 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:14.408212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:14.546413 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:14.556766 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:14.558256 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:14.559443 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-45a631ac-d9f7-416e-95e2-1637e621cb84 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.169015 Aug 24 11:16:14.560142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 415/863] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:14 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:15.587755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:15.588332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:15.594976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:15.595481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:15.595903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:15.596609 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:15.597047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:15.597459 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:15.727888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:15.736479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:15.737978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:15.739168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-42f04b57-e4a1-4b40-a764-427a451d7a88 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.155416 Aug 24 11:16:15.739726 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 449/864] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:15 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:16.764291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:16.765014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:16.772035 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:16.772513 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:16.773336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:16.774030 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:16.774475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:16.774895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:16.918576 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:16.926905 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:16.928426 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:16.929886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3329d2e3-1d01-4f88-a1e7-14292ac40952 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.170620 Aug 24 11:16:16.930441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 416/865] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:16 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:17.952643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:17.953268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:17.960729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:17.961682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:17.962175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:17.963208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:17.963678 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:17.964083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:18.100321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:18.109093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:18.110570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:18.111753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-416c38b8-6958-4dc3-81cf-5a2be7f53ac6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.162985 Aug 24 11:16:18.112303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 450/866] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:17 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:19.134925 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:19.135815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:19.143663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.144095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.144790 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.145727 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:19.146387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:19.147003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:19.297430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:19.309603 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:19.311268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:19.312559 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5de3d4de-2b2a-424b-88e3-4aa9a17b682a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.181733 Aug 24 11:16:19.313942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 417/867] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:19 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:20.337357 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:20.337951 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:20.344640 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:20.345113 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:20.345716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:20.346411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:20.346856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:20.347308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:20.496574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:20.505223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:20.506676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:20.510469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-aacf6f0f-4647-4905-83d2-deca7f7c3e6e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.176939 Aug 24 11:16:20.526151 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 451/868] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:20 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:21.534334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:21.534966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:21.541794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:21.542539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:21.543187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:21.544086 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:21.544699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:21.545264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:21.695118 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:21.707198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:21.709172 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:21.710904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1b850767-2e71-4ec9-ba55-25385e954bc7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.180695 Aug 24 11:16:21.712219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 418/869] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:21 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:16:22.735655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:22.737207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:22.743866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:22.744629 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:22.745264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:22.746314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:22.746756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:22.747518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:22.888934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:22.891831 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=77 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:22.900868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:22.902345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:22.903920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-82e798b4-f1cb-40ad-b900-f66e09ced310 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.173564 Aug 24 11:16:22.904978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 452/870] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:22 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:23.942785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:23.943379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:23.950286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:23.950764 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:23.951215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:23.951893 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:23.952333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:23.952744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:24.111612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:24.122316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:24.124028 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:24.125194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-04d1a460-4f76-47a5-8cc6-67534c184162 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.186822 Aug 24 11:16:24.125987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 419/871] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:23 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:25.152382 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:25.153142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:25.156059 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=29 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:25.164182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:25.164771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:25.165303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:25.166103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:25.166621 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:25.167239 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:25.301654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:25.310811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:25.312344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:25.313500 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1c6ddfb1-47c1-491f-8164-55e4b93933d3 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1742 microversion: 2.20 time: 0.167363 Aug 24 11:16:25.314108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 453/872] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:25 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:26.338420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:26.339077 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:26.341519 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=29 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:26.348852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:26.349346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:26.349780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:26.350966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:26.351605 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:26.353494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:26.360685 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:26.495684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:26.504068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:26.505555 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:26.506751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-753f9286-0b96-4e51-890e-86ed21f8ad7f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1724 microversion: 2.20 time: 0.173090 Aug 24 11:16:26.508002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 420/873] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:26 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:27.534132 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:27.535122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:27.546182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:27.546967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:27.547725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:27.548865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:27.549631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:27.550359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:27.684702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:27.693353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:27.694815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:27.696201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-974a27a9-925c-44a3-9d97-06f3b6edbd05 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1724 microversion: 2.20 time: 0.168321 Aug 24 11:16:27.696662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 454/874] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:27 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:28.718016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:28.719382 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:28.726156 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:28.726637 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:28.727201 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:28.727905 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:28.728358 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:28.728808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:28.880634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:28.889840 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:28.891361 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:28.892516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cc113349-9372-4773-9c26-7eaaee8024c6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1724 microversion: 2.20 time: 0.178525 Aug 24 11:16:28.893073 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 421/875] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:28 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:29.399744 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-3ebf846d-1095-4351-b739-2360b8156fee req-98374dac-50d0-4e67-9310-e2ae277f3e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12fb1be-eff8-42a1-9818-6cf5681c6917", "name": "network-vif-unplugged", "status": "completed", "tag": "db943507-5258-4e45-8aaa-0ce5bc112e88"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:29.411306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-3ebf846d-1095-4351-b739-2360b8156fee req-98374dac-50d0-4e67-9310-e2ae277f3e9f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:29.411779 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-3ebf846d-1095-4351-b739-2360b8156fee req-98374dac-50d0-4e67-9310-e2ae277f3e9f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:29.412194 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-3ebf846d-1095-4351-b739-2360b8156fee req-98374dac-50d0-4e67-9310-e2ae277f3e9f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:29.423611 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.compute.server_external_events [req-3ebf846d-1095-4351-b739-2360b8156fee req-98374dac-50d0-4e67-9310-e2ae277f3e9f service nova] Unable to find a host for instance a12fb1be-eff8-42a1-9818-6cf5681c6917. Dropping event network-vif-unplugged {{(pid=120789) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 11:16:29.424473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-3ebf846d-1095-4351-b739-2360b8156fee req-98374dac-50d0-4e67-9310-e2ae277f3e9f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028869 Aug 24 11:16:29.425225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 455/876] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 11:16:29.920927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:29.921892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:29.932661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:29.933318 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:29.933919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:29.934924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:29.935581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:29.936127 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:30.077245 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:30.089994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:30.092393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:30.094096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-485ed2f6-0eab-4139-9071-c0b2ad97bdd4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1667 microversion: 2.20 time: 0.180353 Aug 24 11:16:30.094884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 422/877] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:29 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1667 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:30.118673 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a561a8c8-6205-4ae7-a399-548804a39369"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:30.121007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:30.127333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:30.127809 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:30.128227 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:30.128899 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:30.129338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:30.129745 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:30.430732 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3bff4a50-3767-4f3d-9810-e1434133a085 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315677 Aug 24 11:16:30.431482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 456/878] 10.222.0.79 () {62 vars in 1364 bytes} [Wed Aug 24 11:16:30 2022] POST /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:16:30.563405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:30.563887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:30.569882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:30.570361 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:30.570809 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:30.571515 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:30.571962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:30.572381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:30.826987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-71892a9a-7527-44d8-91cf-8d6d4f75b1cd tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-volume_attachments/a561a8c8-6205-4ae7-a399-548804a39369" status: 202 len: 0 microversion: 2.20 time: 0.267540 Aug 24 11:16:30.831181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 423/879] 10.222.0.79 () {60 vars in 1457 bytes} [Wed Aug 24 11:16:30 2022] DELETE /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-volume_attachments/a561a8c8-6205-4ae7-a399-548804a39369 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:16:30.891003 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:30.891612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:30.897865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:30.898363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:30.898947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:30.899810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:30.900256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:30.900662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:30.931866 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120789) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:16:31.007355 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ea9002b2-f3bf-46b5-b761-41bd1b2d59e4 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "POST /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/action" status: 202 len: 0 microversion: 2.20 time: 0.120222 Aug 24 11:16:31.008389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 457/880] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Aug 24 11:16:30 2022] POST /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:16:31.016882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:31.018065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:31.026068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:31.026778 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:31.027204 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:31.027889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:31.028340 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:31.028744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:31.208518 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:31.217312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:31.218791 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:31.219977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d03bb77f-3374-4461-815a-ba7495b9769c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1675 microversion: 2.20 time: 0.207240 Aug 24 11:16:31.220700 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 424/881] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:31 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:16:32.244167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:32.244924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:32.251183 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:32.251936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:32.252378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:32.253389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:32.254019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:32.254656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:32.421445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:32.435168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:32.436632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:32.437774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ec484d40-6ea8-4d1d-9350-2170b81c89e1 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.198390 Aug 24 11:16:32.438635 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 458/882] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:32 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:33.461736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:33.462615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:33.470193 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:33.470678 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:33.471121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:33.471811 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:33.472259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:33.472671 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:33.618390 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:33.628065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:33.630284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:33.631736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4da385bd-8e75-4f17-850c-dfae86c8ff83 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.174156 Aug 24 11:16:33.632335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 425/883] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:33 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:34.656373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:34.658574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:34.666017 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:34.666481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:34.666899 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:34.667638 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:34.668074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:34.668635 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:34.804358 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:34.813391 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:34.815072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:34.816302 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-315aa51d-cb2e-452c-a57c-a391cfa017d6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.164723 Aug 24 11:16:34.822656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 459/884] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:34 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:35.841142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:35.841857 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:35.848768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:35.849679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:35.850324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:35.851331 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:35.851781 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:35.852196 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:35.999401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:36.007465 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:36.009016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:36.010268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fd97146b-80ef-4715-bfaf-7806c51207a7 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.173644 Aug 24 11:16:36.010822 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 426/885] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:35 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:37.036718 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:37.037761 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:37.046753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:37.047262 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:37.047688 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:37.048379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:37.048844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:37.049242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:37.186196 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:37.199390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:37.201647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:37.203481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d9109e44-2810-4560-a835-4c16fcecaadc tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.173111 Aug 24 11:16:37.204286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 460/886] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:37 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:38.236449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:38.237336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:38.246183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:38.246671 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:38.247122 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:38.247854 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:38.248283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:38.248704 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:38.394175 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:38.407702 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:38.409191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:38.410348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3ee7d5e3-9930-4a83-9951-3377995e46c0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.182829 Aug 24 11:16:38.411081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 427/887] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:38 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:39.434870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:39.435578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:39.454484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:39.454911 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:39.455384 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:39.456122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:39.456568 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:39.456983 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:39.774156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:39.789440 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:39.791158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:39.792426 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-89944010-05a2-4b6f-bf49-398e6c209a26 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.362806 Aug 24 11:16:39.799266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 461/888] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:39 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:40.815573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:40.816138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:40.831160 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:40.831642 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:40.832114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:40.832770 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:40.833172 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:40.833599 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:41.042764 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:41.051476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:41.053223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:41.054553 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c3f46802-b616-4c5d-afe1-7a542e091a0a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.242960 Aug 24 11:16:41.079167 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 428/889] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:40 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:42.081192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:42.082571 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:42.089777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:42.090761 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:42.091586 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:42.092409 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:42.092955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:42.093470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:42.316272 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:42.327515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:42.329227 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:42.330462 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6012df4a-9c5c-4f41-95c4-945a0e8a6c85 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.253500 Aug 24 11:16:42.347444 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 462/890] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:42 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:43.354274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:43.354942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:43.361780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:43.362268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:43.362737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:43.363458 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:43.363904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:43.364291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:43.505866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:43.514661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:43.516150 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:43.517664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-98a42071-43cf-4814-adce-07baa8589dee tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.167333 Aug 24 11:16:43.518109 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 429/891] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:43 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:44.541413 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:44.542088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:44.549182 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:44.549689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:44.550105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:44.550763 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:44.551398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:44.551644 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:44.766406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:44.767368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:44.770835 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:44.776241 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:44.777910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:44.779091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0e69e4bb-f5ab-4b1f-9255-a20554bbed02 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.241970 Aug 24 11:16:44.779378 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:44.780030 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:44.780826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:44.781696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:44.782316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:44.782890 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:44.792880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 463/892] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:44 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:44.801239 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-5952b038-f6a4-4d6a-abf5-022bff1f87a3 req-a87437f4-299c-43cd-8a3c-f54a9ac55824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce", "tag": "2bd4251a-385e-4718-b6a2-35c629d4bbb6"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:44.812234 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-5952b038-f6a4-4d6a-abf5-022bff1f87a3 req-a87437f4-299c-43cd-8a3c-f54a9ac55824 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:44.812820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-5952b038-f6a4-4d6a-abf5-022bff1f87a3 req-a87437f4-299c-43cd-8a3c-f54a9ac55824 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:44.813239 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-5952b038-f6a4-4d6a-abf5-022bff1f87a3 req-a87437f4-299c-43cd-8a3c-f54a9ac55824 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:44.813378 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:16:44.827437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-5952b038-f6a4-4d6a-abf5-022bff1f87a3 req-a87437f4-299c-43cd-8a3c-f54a9ac55824 service nova] Creating event network-changed:2bd4251a-385e-4718-b6a2-35c629d4bbb6 for instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce on hv-cinder-85427 Aug 24 11:16:44.833622 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-5952b038-f6a4-4d6a-abf5-022bff1f87a3 req-a87437f4-299c-43cd-8a3c-f54a9ac55824 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039485 Aug 24 11:16:44.834223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 464/893] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:44.907314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7717c4fa-cd34-4b90-a463-74d427276e0b tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 204 len: 0 microversion: 2.1 time: 0.149367 Aug 24 11:16:44.907902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 430/894] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:16:44 2022] DELETE /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:16:44.917188 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:44.917878 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:44.924114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:44.924589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:44.925180 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:44.926054 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:44.926503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:44.926917 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:45.119216 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:45.127817 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-76f26b4d-5dca-42ac-9037-1befec7d8e0a tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.215354 Aug 24 11:16:45.128625 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 465/895] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:44 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:45.806703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:45.807498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:45.814545 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:45.815161 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:45.815656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:45.816490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:45.817018 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:45.817503 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:45.962556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:45.975943 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:45.977849 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:45.979161 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e03de3f3-35f0-42a7-ad15-22fe4758fbc6 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.177112 Aug 24 11:16:45.979740 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 431/896] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:45 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:46.151178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:46.151873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:46.158375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:46.158844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:46.159294 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:46.160019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:46.160454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:46.160888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:46.298598 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:46.306715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9bfd6ac9-5b68-4bf0-a2a6-26b4b6a1c186 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.160366 Aug 24 11:16:46.307347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 466/897] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:46 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:47.006768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:47.007841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:47.018484 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:47.019348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:47.020040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:47.021156 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:47.021900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:47.022969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:47.042487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:47.166329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:47.175641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:47.177147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:47.178378 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-22f9f622-7f30-4359-82f7-2abf248830ac tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.178215 Aug 24 11:16:47.178921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 432/898] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:46 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:47.331892 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:47.332731 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:47.342989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:47.343770 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:47.344411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:47.345437 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:47.346106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:47.346733 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:47.350685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:47.486885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:47.498902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-05cc1de1-20ff-4ae2-bdae-72164e7902c2 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.172983 Aug 24 11:16:47.499842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 467/899] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:47 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:48.205826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:48.206809 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:48.217769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:48.218457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:48.219215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:48.220410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:48.221155 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:48.221852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:48.360176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:48.374991 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:48.377505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:48.379716 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3dfa812d-005c-4e57-b982-17f577bb715a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.180096 Aug 24 11:16:48.380754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 433/900] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:48 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:48.527734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:48.528407 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:48.536223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:48.536773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:48.537269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:48.538054 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:48.538569 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:48.539083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:48.677939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:48.685952 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8f8deb7f-5568-44ac-bbe0-c2f538def159 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1570 microversion: 2.1 time: 0.164402 Aug 24 11:16:48.686596 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 468/901] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:48 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:49.411190 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:49.412385 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:49.419367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:49.420074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:49.420669 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:49.421537 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:49.422129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:49.422713 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:49.602462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:49.612845 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:49.614595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:49.615967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6c62849e-1679-4a5e-90ee-11478deb7e0b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.208814 Aug 24 11:16:49.617201 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 434/902] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:49 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:49.707631 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:49.708236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:49.715220 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:49.715859 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:49.716484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:49.717173 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:49.717608 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:49.718011 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:49.873359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df7721c8a694faebb58c00a0d870506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e957f00a814f2b89505181e43ba856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:49.882041 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d2a47265-6224-4eeb-8400-08ac5fc3f39d tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 200 len: 1451 microversion: 2.1 time: 0.178408 Aug 24 11:16:49.883103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 469/903] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:49 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:16:50.024792 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-a3699d49-0eb4-4973-9b7f-18d5ec0daf0a req-eb17bbab-73e3-406c-b391-3644afc0c692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce", "name": "network-vif-deleted", "tag": "2bd4251a-385e-4718-b6a2-35c629d4bbb6"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:50.036479 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a3699d49-0eb4-4973-9b7f-18d5ec0daf0a req-eb17bbab-73e3-406c-b391-3644afc0c692 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:50.037235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a3699d49-0eb4-4973-9b7f-18d5ec0daf0a req-eb17bbab-73e3-406c-b391-3644afc0c692 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:50.037889 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a3699d49-0eb4-4973-9b7f-18d5ec0daf0a req-eb17bbab-73e3-406c-b391-3644afc0c692 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:50.063875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-a3699d49-0eb4-4973-9b7f-18d5ec0daf0a req-eb17bbab-73e3-406c-b391-3644afc0c692 service nova] Creating event network-vif-deleted:2bd4251a-385e-4718-b6a2-35c629d4bbb6 for instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce on hv-cinder-85427 Aug 24 11:16:50.073233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-a3699d49-0eb4-4973-9b7f-18d5ec0daf0a req-eb17bbab-73e3-406c-b391-3644afc0c692 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052498 Aug 24 11:16:50.074027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 435/904] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:50.641936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:50.642710 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:50.650122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:50.650842 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:50.651308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:50.651999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:50.652445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:50.652852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:50.876146 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:50.885371 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:50.886936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:50.888252 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7d999e68-4521-4595-9837-2301a1e69f7c tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.250803 Aug 24 11:16:50.888889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 470/905] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:50 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:16:50.905987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:50.907437 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] [instance: 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:50.913581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:50.914059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:50.914456 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:50.915183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:50.916123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:50.916377 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:50.931531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] HTTP exception thrown: Instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce could not be found. Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Request method failure captured: Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce HTTP/1.1 Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgb7MjuAHAGR7php5et43rWCzHSDOvPlpaUiCLaLJ3EGTUmiRiNKuNJYTyZgieEqAgSAV-5ho4I-X-HSt95sTqyjvMvkzIv0-lVOIUefzrmwNUlUBxNokP-7nB_dCQdei1mJQQVOt4ZSOzC2avfxgztbSX5j0u7bL-c0qmqxwJ-rHms Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f1e957f00a814f2b89505181e43ba856 Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestShelveInstance-1847434550 Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:16:50.933206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f1e957f00a814f2b89505181e43ba856", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f1e957f00a814f2b89505181e43ba856"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f1e957f00a814f2b89505181e43ba856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f1e957f00a814f2b89505181e43ba856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestShelveInstance-1847434550 Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f1e957f00a814f2b89505181e43ba856 Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestShelveInstance-1847434550 Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestShelveInstance-1847434550-project Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 8df7721c8a694faebb58c00a0d870506 Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestShelveInstance-1847434550-project Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce could not be found. Aug 24 11:16:50.934876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce'} Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce could not be found. Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:16:50.935813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce could not be found. Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce could not be found. Aug 24 11:16:50.937374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:16:50.938766 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Returning 404 to user: Instance 5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:16:50.938766 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ee809558-bd7a-47fc-8d33-35f9785358c3 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce" status: 404 len: 111 microversion: 2.1 time: 0.034138 Aug 24 11:16:50.938766 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 436/906] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:16:50 2022] GET /compute/v2.1/servers/5c8ff45b-f9f2-46b9-835c-d77dfd90b2ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:16:51.131632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-07d43769-8744-4e14-a0c8-78110a2bbe10 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] Calling method '.version_select at 0x7f82b6176700>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:51.154989 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-07d43769-8744-4e14-a0c8-78110a2bbe10 tempest-TestShelveInstance-1847434550 tempest-TestShelveInstance-1847434550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1973796702" status: 202 len: 0 microversion: 2.1 time: 0.027877 Aug 24 11:16:51.159074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 471/907] 10.222.0.79 () {58 vars in 1254 bytes} [Wed Aug 24 11:16:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1973796702 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:16:51.769904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-1ea989ff-b82b-4ede-a97f-ceaeef4db953 req-678283cf-fc5f-49a3-ac81-1937421e0040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12fb1be-eff8-42a1-9818-6cf5681c6917", "name": "network-vif-plugged", "status": "completed", "tag": "db943507-5258-4e45-8aaa-0ce5bc112e88"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:16:51.782133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1ea989ff-b82b-4ede-a97f-ceaeef4db953 req-678283cf-fc5f-49a3-ac81-1937421e0040 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:51.782901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1ea989ff-b82b-4ede-a97f-ceaeef4db953 req-678283cf-fc5f-49a3-ac81-1937421e0040 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:51.783517 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-1ea989ff-b82b-4ede-a97f-ceaeef4db953 req-678283cf-fc5f-49a3-ac81-1937421e0040 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:51.798307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-1ea989ff-b82b-4ede-a97f-ceaeef4db953 req-678283cf-fc5f-49a3-ac81-1937421e0040 service nova] Creating event network-vif-plugged:db943507-5258-4e45-8aaa-0ce5bc112e88 for instance a12fb1be-eff8-42a1-9818-6cf5681c6917 on hv-cinder-85427 Aug 24 11:16:51.804281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-1ea989ff-b82b-4ede-a97f-ceaeef4db953 req-678283cf-fc5f-49a3-ac81-1937421e0040 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037989 Aug 24 11:16:51.805189 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 437/908] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:16:51.913222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:51.913815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:51.937110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:51.942052 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:51.942590 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:51.945319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:51.946040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:51.947367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:52.231105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:52.241083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:52.242593 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:52.243888 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ec9238db-d518-43b5-96e1-33df3a5b7930 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.335320 Aug 24 11:16:52.244582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 472/909] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:51 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:53.268912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:53.269596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:53.283009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:53.283543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:53.283980 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:53.284687 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:53.285136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:53.285661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:53.611785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:53.626096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:53.628104 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:53.629317 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-540c2921-b2bf-4cc6-afa8-3d4b4437d2d0 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.365473 Aug 24 11:16:53.632292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 438/910] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:53 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:54.659661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:54.661010 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:54.682341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:54.684539 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:54.684539 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:54.687869 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:54.689405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:54.690427 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:55.046464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:55.056403 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:55.058224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:55.059654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-aa29de1e-03ce-4f9f-a86d-510178c9058b tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1733 microversion: 2.20 time: 0.408494 Aug 24 11:16:55.060701 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 473/911] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:54 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1733 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:16:56.355992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:16:56.357217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:16:56.362916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:16:56.364543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:56.365180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:56.365791 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:56.366661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:16:56.367345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:16:56.367902 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:16:56.688048 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:56.703319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:56.706489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:16:56.708051 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f2349947-4601-473e-bc1d-602829c4202e tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1720 microversion: 2.20 time: 0.628000 Aug 24 11:16:56.710181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 439/912] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:16:56 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1720 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:17:03.493031 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2f3a2778-0af5-4d91-81f9-683a1c44e317 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Action: 'create', calling method: .version_select at 0x7f82b6114280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2091664764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC1NGSI+aNUEoP8lAPL3KYiwxtWLwENo85U3+p78wOAixBe8DVCZYqU6+24qwqJEeXfDIRMQU7EUP/NwD4h3oilKUqiXuKmqkQeITMXpbdz9iGBOJgPAnldX47MRaWRJA=="}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:03.499007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:03.514374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-2f3a2778-0af5-4d91-81f9-683a1c44e317 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:17:03.518669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-2f3a2778-0af5-4d91-81f9-683a1c44e317 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for user c671384bbcc7405b85856efbc8dde5de and project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:17:03.547524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2f3a2778-0af5-4d91-81f9-683a1c44e317 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.271764 Aug 24 11:17:03.548206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 474/913] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:17:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:22.398754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:22.399499 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=32 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:22.560266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:22.560759 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:22.566756 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:22.567272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:22.567686 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:22.568368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:22.568816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:22.569233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:22.592026 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eff81ec1-c502-41a6-a17a-76ee35addd62 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/ips" status: 200 len: 144 microversion: 2.1 time: 0.198428 Aug 24 11:17:22.592558 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 440/914] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:17:22 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/ips => generated 144 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:25.031868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d42c76e0-3ffe-4934-b610-fcfe8836d1c8"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:25.034170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:25.036228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=35 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:25.037066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=4 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:25.037575 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:25.045500 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:25.046059 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:25.046505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:25.047229 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:25.047703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:25.048145 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:25.325340 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d55ba0f2-1d14-4b12-8712-36585d5b95fd tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297312 Aug 24 11:17:25.325962 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 475/915] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:17:25 2022] POST /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:30.549958 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-335971649", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2091664764", "security_groups": [{"name": "tempest-secgroup-smoke-533430042"}], "block_device_mapping_v2": [{"uuid": "3bbdc01c-54e1-45ab-ab12-38f9a17a043b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "843628f4-43b9-4b8d-9051-b767617bbe5b"}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:30.675921 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] validate_networks() for [('843628f4-43b9-4b8d-9051-b767617bbe5b', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:17:31.207676 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:17:31.208093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:17:31.208562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:17:31.208964 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:17:31.209374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:17:31.219855 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:31.220267 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:31.220691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:31.221376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:31.221857 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:31.222282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:31.240463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:17:31.245008 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for user c671384bbcc7405b85856efbc8dde5de and project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:17:31.311487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:17:31.313588 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3bbdc01c-54e1-45ab-ab12-38f9a17a043b',volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:17:31.460329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d0420c1a-e5e0-4e96-bebd-f748edac8aba tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914229 Aug 24 11:17:31.460971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 441/916] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:17:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:17:31.475592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0a01bd77-f3dd-4fe4-9d56-0cdb79c351bd tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:31.476964 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0a01bd77-f3dd-4fe4-9d56-0cdb79c351bd tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:31.547706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-0a01bd77-f3dd-4fe4-9d56-0cdb79c351bd tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:31.555449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0a01bd77-f3dd-4fe4-9d56-0cdb79c351bd tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1094 microversion: 2.1 time: 0.085728 Aug 24 11:17:31.556018 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 476/917] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:31 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:17:32.577425 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:32.578047 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:32.585412 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:32.585881 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:32.586539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:32.587460 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:32.587903 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:32.588310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:32.656953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:32.665047 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8579e973-9f9d-450a-aee7-5b1a48ddd10e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1200 microversion: 2.1 time: 0.091565 Aug 24 11:17:32.665616 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 442/918] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:32 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:32.909791 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:32.912013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:32.919233 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:32.919718 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:32.920144 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:32.920820 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:32.921264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:32.921677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:32.954067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c01a4773-09c5-46a7-bf75-eae1f3a1871b tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Aug 24 11:17:32.954588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 477/919] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:17:32 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:32.965519 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:32.966102 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:32.972125 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:32.972627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:32.973048 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:32.973736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:32.974188 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:32.974634 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:33.004780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0ab0a4d2-b597-45c1-a2cf-52530806018d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/d42c76e0-3ffe-4934-b610-fcfe8836d1c8" status: 200 len: 194 microversion: 2.1 time: 0.043483 Aug 24 11:17:33.005384 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 443/920] 10.222.0.79 () {58 vars in 1413 bytes} [Wed Aug 24 11:17:32 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/d42c76e0-3ffe-4934-b610-fcfe8836d1c8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:33.686158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:33.686778 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:33.693268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:33.693740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:33.694179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:33.694848 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:33.695430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:33.695913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:33.833995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:33.842577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9ce0520b-ccf1-4fde-8f52-3122f4e892d0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.160416 Aug 24 11:17:33.843220 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 478/921] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:33 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:33.988369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-e4357146-0299-4302-b8ae-ea057f35885b req-ab1c61ac-c5bf-44ee-a28e-388096111a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e7a1e2-de96-447d-b786-d19bd604b744", "tag": "8093798d-0cbc-44fa-9a51-b7647671e836"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:34.000238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4357146-0299-4302-b8ae-ea057f35885b req-ab1c61ac-c5bf-44ee-a28e-388096111a2a service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:34.000630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4357146-0299-4302-b8ae-ea057f35885b req-ab1c61ac-c5bf-44ee-a28e-388096111a2a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:34.001053 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e4357146-0299-4302-b8ae-ea057f35885b req-ab1c61ac-c5bf-44ee-a28e-388096111a2a service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:34.013368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-e4357146-0299-4302-b8ae-ea057f35885b req-ab1c61ac-c5bf-44ee-a28e-388096111a2a service nova] Creating event network-changed:8093798d-0cbc-44fa-9a51-b7647671e836 for instance 69e7a1e2-de96-447d-b786-d19bd604b744 on hv-cinder-85427 Aug 24 11:17:34.018436 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-e4357146-0299-4302-b8ae-ea057f35885b req-ab1c61ac-c5bf-44ee-a28e-388096111a2a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Aug 24 11:17:34.019031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 444/922] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:34.390594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd65d4ad-8a22-4bb1-9c94-9611b1e986f9"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:34.392906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:34.399682 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:34.400155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:34.400573 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:34.401320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:34.401725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:34.402396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:34.869324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:34.870459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:34.877537 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:34.878017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:34.878487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:34.879175 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:34.879617 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:34.880031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:35.028608 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:35.036754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9adf18cb-a465-4a7d-8cf8-ca1a347dba04 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.174532 Aug 24 11:17:35.037316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 445/923] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:34 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:35.454155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-604f1529-83ff-4ea3-bbec-4bdafd269a01 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "POST /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.067374 Aug 24 11:17:35.455110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 479/924] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:17:34 2022] POST /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments => generated 194 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:36.065722 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:36.066319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:36.073261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:36.073763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:36.074719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:36.075120 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:36.075579 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:36.075997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:36.219345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:36.231491 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c8fcc3bf-5c1d-4878-a907-17a6fb7b1e06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.169657 Aug 24 11:17:36.232043 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 446/925] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:36 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:37.253728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:37.254431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:37.260780 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:37.261260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:37.261958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:37.262652 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:37.263136 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:37.263562 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:37.399030 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:37.406939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d294887a-7965-4237-a549-38685b7b3451 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.157957 Aug 24 11:17:37.407543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 480/926] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:37 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:38.432012 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:38.432915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:38.444222 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:38.445011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:38.445720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:38.446835 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:38.447813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:38.448509 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:38.600616 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:38.613465 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7c864b0d-f3c4-4f06-a7a0-acd5448a10d2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.187663 Aug 24 11:17:38.614323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 447/927] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:38 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:39.638328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:39.638926 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:39.645585 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:39.646068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:39.646470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:39.647174 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:39.647643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:39.648458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:39.784837 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:39.792469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-470a7ddd-2690-4517-8c16-b77d42214ecb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.158627 Aug 24 11:17:39.793091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 481/928] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:39 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:40.814353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:40.814983 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:40.821775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:40.822254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:40.822680 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:40.823395 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:40.823843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:40.824313 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:40.973335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:40.983738 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-55b377ab-8d89-4022-a53c-3390d1250705 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.172843 Aug 24 11:17:40.984470 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 448/929] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:40 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:42.008913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:42.012943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:42.013530 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:42.020066 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:42.020541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:42.020950 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:42.021622 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:42.022063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:42.022473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:42.172515 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:42.182480 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-78e36ced-f4b2-44de-9c65-915cdb5e0a34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.174680 Aug 24 11:17:42.183167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 482/930] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:42 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:43.036306 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:43.038548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:43.040531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:43.041183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:43.047975 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.048508 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.048962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.049708 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.050156 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.050572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.082926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6ce12ba9-0f2c-4519-b33a-b4d5a80068c2 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050533 Aug 24 11:17:43.083523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 449/931] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:17:43 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:43.204796 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:43.205388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:43.212375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.212845 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.213275 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.218478 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.219698 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.220152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.227457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:43.227942 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:43.234831 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.235334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.235753 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.236430 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.236867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.237275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.269053 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e9eedb79-f32a-4833-85b2-efba44c1f561 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/d42c76e0-3ffe-4934-b610-fcfe8836d1c8" status: 200 len: 194 microversion: 2.1 time: 0.045112 Aug 24 11:17:43.269924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 450/932] 10.222.0.79 () {58 vars in 1413 bytes} [Wed Aug 24 11:17:43 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/d42c76e0-3ffe-4934-b610-fcfe8836d1c8 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:43.284682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:43.285548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:43.295093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.295712 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.296449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.297300 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:43.297835 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:43.298384 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:43.374259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:43.382655 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-34419318-2262-4942-9fd5-9249c40f0040 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.181445 Aug 24 11:17:43.388177 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lazy-loading 'services' on Instance uuid bc62ce05-f502-46d7-8979-1e1c372c157b {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:17:43.395222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 483/933] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:43 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:43.467234 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0178b4e8-5aa3-4d9c-9bf3-60024ddf5dc1 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/d42c76e0-3ffe-4934-b610-fcfe8836d1c8" status: 202 len: 0 microversion: 2.1 time: 0.189889 Aug 24 11:17:43.467818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 451/934] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:17:43 2022] DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/d42c76e0-3ffe-4934-b610-fcfe8836d1c8 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:17:44.404388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:44.405165 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:44.412855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:44.413256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:44.413680 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:44.414370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:44.414816 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:44.415229 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:44.560460 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:44.570288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b4301146-b33b-4cc3-8cbf-e955ede4ad7b tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.170408 Aug 24 11:17:44.570935 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 484/935] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:44 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:44.599591 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:44.600150 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:44.607698 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:44.608188 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:44.608650 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:44.609337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:44.609791 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:44.610214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:44.640366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aa728a00-e706-4ebc-a590-23836ac0e3ec tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/bd65d4ad-8a22-4bb1-9c94-9611b1e986f9" status: 200 len: 194 microversion: 2.1 time: 0.045214 Aug 24 11:17:44.640948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 452/936] 10.222.0.79 () {58 vars in 1413 bytes} [Wed Aug 24 11:17:44 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/bd65d4ad-8a22-4bb1-9c94-9611b1e986f9 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:44.655289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:44.655777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:44.661952 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:44.662469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:44.663350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:44.663612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:44.664099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:44.664560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:44.746505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lazy-loading 'services' on Instance uuid bc62ce05-f502-46d7-8979-1e1c372c157b {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:17:44.827509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-97ae744f-1020-499b-9c8e-ad47089c684e tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/bd65d4ad-8a22-4bb1-9c94-9611b1e986f9" status: 202 len: 0 microversion: 2.1 time: 0.175998 Aug 24 11:17:44.828336 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 485/937] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:17:44 2022] DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments/bd65d4ad-8a22-4bb1-9c94-9611b1e986f9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:17:45.592749 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:45.593356 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:45.599655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:45.600209 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:45.600562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:45.601280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:45.601727 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:45.602158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:45.751674 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:45.760212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f3714f03-52de-4c10-9e91-09c5b7e21b62 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.172764 Aug 24 11:17:45.760867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 453/938] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:45 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:45.788443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-d7d1cf4e-f27a-4195-a378-ec691dd61c2d req-bd5c0d83-77f4-4916-b706-696792831399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e7a1e2-de96-447d-b786-d19bd604b744", "name": "network-vif-plugged", "status": "completed", "tag": "8093798d-0cbc-44fa-9a51-b7647671e836"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:45.800359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-d7d1cf4e-f27a-4195-a378-ec691dd61c2d req-bd5c0d83-77f4-4916-b706-696792831399 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:45.800834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-d7d1cf4e-f27a-4195-a378-ec691dd61c2d req-bd5c0d83-77f4-4916-b706-696792831399 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:45.801248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-d7d1cf4e-f27a-4195-a378-ec691dd61c2d req-bd5c0d83-77f4-4916-b706-696792831399 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:45.812648 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-d7d1cf4e-f27a-4195-a378-ec691dd61c2d req-bd5c0d83-77f4-4916-b706-696792831399 service nova] Creating event network-vif-plugged:8093798d-0cbc-44fa-9a51-b7647671e836 for instance 69e7a1e2-de96-447d-b786-d19bd604b744 on hv-cinder-85427 Aug 24 11:17:45.817567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-d7d1cf4e-f27a-4195-a378-ec691dd61c2d req-bd5c0d83-77f4-4916-b706-696792831399 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034381 Aug 24 11:17:45.818310 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 486/939] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:17:46.007564 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:46.009696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:46.016314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.016478 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.016916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.017612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.018741 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.019309 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.049926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d2575191-4330-4dbe-8d46-2db23271e443 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046229 Aug 24 11:17:46.050696 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 454/940] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:17:46 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:17:46.173253 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:46.175615 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:46.182019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.182479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.182921 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.183634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.184264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.184774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.215624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f0378ef9-2e42-44bf-80f3-5f42fe40d4ef tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046463 Aug 24 11:17:46.216128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 487/941] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:17:46 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:17:46.280980 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:46.281475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:46.288006 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.288486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.288910 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.289583 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.290024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.290444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.316098 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:17:46.378276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:46.417334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6fe3e8fb-c26c-43d5-9f82-b776c97d002d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 204 len: 0 microversion: 2.1 time: 0.139976 Aug 24 11:17:46.418087 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 455/942] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:17:46 2022] DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:17:46.428325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:46.428933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:46.436432 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.437049 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.437462 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.438399 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.438841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.439369 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.575625 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:46.587535 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c1e93864-0faf-4a79-b846-d2a9b23fe42f tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1671 microversion: 2.1 time: 0.163340 Aug 24 11:17:46.588297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 488/943] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:46 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:17:46.783816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:46.784513 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:46.791292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.791769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.792195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.792869 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:46.793312 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:46.793724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:46.948079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:46.956392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7e8751bf-94f0-4677-98e3-7b0f214f4e2f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.176952 Aug 24 11:17:46.956946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 456/944] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:46 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:47.619577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:47.620558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:47.628520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:47.628999 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:47.629425 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:47.630103 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:47.630546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:47.630960 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:47.775891 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:47.779479 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:47.784974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-acee0128-bf5a-46ca-bf2d-575c6d6038b3 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1671 microversion: 2.1 time: 0.171692 Aug 24 11:17:47.785518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 489/945] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:47 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:47.980929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:47.982014 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:47.989379 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:47.989856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:47.990279 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:47.990976 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:47.991435 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:47.991854 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:48.142901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:48.151607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9927357d-4f68-440e-b498-9dbd111fccf8 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1265 microversion: 2.1 time: 0.177201 Aug 24 11:17:48.152163 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 457/946] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:47 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:48.815774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:48.816524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:48.825946 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:48.826534 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:48.827095 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:48.827943 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:48.828386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:48.828794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:48.962995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:48.970920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a9c9fcbe-cd57-4c0c-a193-028d1ac13722 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1671 microversion: 2.1 time: 0.160395 Aug 24 11:17:48.971525 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 490/947] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:48 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:49.172664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:49.173264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:49.179915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:49.180395 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:49.180826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:49.181507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:49.181948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:49.182374 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:49.323213 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:49.332292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8354fe7b-62ae-49aa-872c-ef7744dd7eae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1453 microversion: 2.1 time: 0.163558 Aug 24 11:17:49.332874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 458/948] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:49 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:49.353658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:49.354265 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:49.361060 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:49.361541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:49.361971 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:49.362667 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:49.363136 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:49.363549 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:49.512897 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:49.521589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2a92b145-6d13-41eb-9c12-1b6a3d54541a tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1453 microversion: 2.1 time: 0.171814 Aug 24 11:17:49.522161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 491/949] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:49 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:49.992808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:49.993322 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:50.000585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:50.001070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:50.001500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:50.002194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:50.002647 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:50.003094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:50.089286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b3ce054ae04f8e9db0cdc3a13867e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808dbefab4f0467c8f6ff0f18453d0b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:17:50.102185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9545241b-1bfb-48eb-b38b-f3cbe33b6218 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 200 len: 1604 microversion: 2.1 time: 0.113529 Aug 24 11:17:50.103391 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 459/950] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:49 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 1604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:50.172488 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-8a64dd09-02ca-4fcc-8882-65d7bbe93020 req-74f67792-81d0-4df1-aefe-418bb4ad048e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc62ce05-f502-46d7-8979-1e1c372c157b", "name": "network-vif-deleted", "tag": "2ee675a8-84a6-480a-b02e-1e92a55084ba"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:50.186567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8a64dd09-02ca-4fcc-8882-65d7bbe93020 req-74f67792-81d0-4df1-aefe-418bb4ad048e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:50.188035 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8a64dd09-02ca-4fcc-8882-65d7bbe93020 req-74f67792-81d0-4df1-aefe-418bb4ad048e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:50.188865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8a64dd09-02ca-4fcc-8882-65d7bbe93020 req-74f67792-81d0-4df1-aefe-418bb4ad048e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:50.207839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-8a64dd09-02ca-4fcc-8882-65d7bbe93020 req-74f67792-81d0-4df1-aefe-418bb4ad048e service nova] Creating event network-vif-deleted:2ee675a8-84a6-480a-b02e-1e92a55084ba for instance bc62ce05-f502-46d7-8979-1e1c372c157b on hv-cinder-85427 Aug 24 11:17:50.223363 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-8a64dd09-02ca-4fcc-8882-65d7bbe93020 req-74f67792-81d0-4df1-aefe-418bb4ad048e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056358 Aug 24 11:17:50.224748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 492/951] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:51.127487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:51.128827 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:51.135999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:51.136632 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:51.137192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:51.138003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:51.138552 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:51.139037 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:51.156163 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] HTTP exception thrown: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Request method failure captured: Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b HTTP/1.1 Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZMk3NR_sexKwz-2gBaSftE9rFlvpuetTPgUqE5OkZk6yUJ7wbG0wVwMpdGxrBZYqYaOgigY0W1BhJ8uPmPRCw_i864x7ksGUkD2xV1oopQcuGZjDqRBmAn5edordmL3V0MaTdeEo7dzy-7-vlk9d8Xf-rFD91zF1ABVaInXGii0rM Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:17:51.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_808dbefab4f0467c8f6ff0f18453d0b0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 28b3ce054ae04f8e9db0cdc3a13867e9 Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:51.159649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'bc62ce05-f502-46d7-8979-1e1c372c157b'} Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:17:51.160469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:51.161856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:51.165266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Returning 404 to user: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:17:51.165266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac4a56a7-6594-4c60-9cce-f8cd360284ee tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 404 len: 111 microversion: 2.1 time: 0.036396 Aug 24 11:17:51.165266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 460/952] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:51 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:17:51.169000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-77be3645-d77e-4755-b6f3-08fc2cd511f4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '.version_select at 0x7f82b60e68b0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:51.189697 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-77be3645-d77e-4755-b6f3-08fc2cd511f4 tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-642138192" status: 202 len: 0 microversion: 2.1 time: 0.024311 Aug 24 11:17:51.193305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 493/953] 10.222.0.79 () {58 vars in 1218 bytes} [Wed Aug 24 11:17:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-642138192 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:17:52.241389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-e2fcafd8-2570-490a-9107-9c6ac7382b67 req-2d7a1b90-f57a-41e3-884e-94923c3c4345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e7a1e2-de96-447d-b786-d19bd604b744", "tag": "8093798d-0cbc-44fa-9a51-b7647671e836"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:52.252595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e2fcafd8-2570-490a-9107-9c6ac7382b67 req-2d7a1b90-f57a-41e3-884e-94923c3c4345 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:52.252762 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e2fcafd8-2570-490a-9107-9c6ac7382b67 req-2d7a1b90-f57a-41e3-884e-94923c3c4345 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:52.253185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-e2fcafd8-2570-490a-9107-9c6ac7382b67 req-2d7a1b90-f57a-41e3-884e-94923c3c4345 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:52.265813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-e2fcafd8-2570-490a-9107-9c6ac7382b67 req-2d7a1b90-f57a-41e3-884e-94923c3c4345 service nova] Creating event network-changed:8093798d-0cbc-44fa-9a51-b7647671e836 for instance 69e7a1e2-de96-447d-b786-d19bd604b744 on hv-cinder-85427 Aug 24 11:17:52.271262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-e2fcafd8-2570-490a-9107-9c6ac7382b67 req-2d7a1b90-f57a-41e3-884e-94923c3c4345 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034091 Aug 24 11:17:52.272182 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 461/954] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:54.126255 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:54.126932 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:54.138861 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:54.139454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:54.140186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:54.141191 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:54.141648 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:54.142069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:54.156388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] HTTP exception thrown: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Request method failure captured: Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b HTTP/1.1 Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZMk3NR_sexKwz-2gBaSftE9rFlvpuetTPgUqE5OkZk6yUJ7wbG0wVwMpdGxrBZYqYaOgigY0W1BhJ8uPmPRCw_i864x7ksGUkD2xV1oopQcuGZjDqRBmAn5edordmL3V0MaTdeEo7dzy-7-vlk9d8Xf-rFD91zF1ABVaInXGii0rM Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:17:54.158044 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_808dbefab4f0467c8f6ff0f18453d0b0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 28b3ce054ae04f8e9db0cdc3a13867e9 Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.159660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'bc62ce05-f502-46d7-8979-1e1c372c157b'} Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:17:54.160624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.162016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.163578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Returning 404 to user: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:17:54.163578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9c37006b-2b03-422a-b9ef-0e98278462ac tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 404 len: 111 microversion: 2.1 time: 0.040759 Aug 24 11:17:54.163578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 494/955] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:17:54 2022] DELETE /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:17:54.169439 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:54.170133 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: bc62ce05-f502-46d7-8979-1e1c372c157b] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:54.172736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:54.178778 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:54.179307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:54.179683 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:54.180384 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:54.180833 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:54.181252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:54.196457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] HTTP exception thrown: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Request method failure captured: Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b HTTP/1.1 Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZMk3NR_sexKwz-2gBaSftE9rFlvpuetTPgUqE5OkZk6yUJ7wbG0wVwMpdGxrBZYqYaOgigY0W1BhJ8uPmPRCw_i864x7ksGUkD2xV1oopQcuGZjDqRBmAn5edordmL3V0MaTdeEo7dzy-7-vlk9d8Xf-rFD91zF1ABVaInXGii0rM Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:17:54.198083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_808dbefab4f0467c8f6ff0f18453d0b0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 28b3ce054ae04f8e9db0cdc3a13867e9 Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.199573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'bc62ce05-f502-46d7-8979-1e1c372c157b'} Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:17:54.200342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. Aug 24 11:17:54.201548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:54.202897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Returning 404 to user: Instance bc62ce05-f502-46d7-8979-1e1c372c157b could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:17:54.202897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bc891af5-2dc4-4cad-842c-b2255651b9fe tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b" status: 404 len: 111 microversion: 2.1 time: 0.034904 Aug 24 11:17:54.202897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 462/956] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:54 2022] GET /compute/v2.1/servers/bc62ce05-f502-46d7-8979-1e1c372c157b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:17:55.359351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:55.360469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:55.364050 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:55.372145 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:55.372783 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:55.373431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:55.374949 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:55.375442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:55.375863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:55.391200 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] HTTP exception thrown: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Request method failure captured: Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: DELETE /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe HTTP/1.1 Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZMk3NR_sexKwz-2gBaSftE9rFlvpuetTPgUqE5OkZk6yUJ7wbG0wVwMpdGxrBZYqYaOgigY0W1BhJ8uPmPRCw_i864x7ksGUkD2xV1oopQcuGZjDqRBmAn5edordmL3V0MaTdeEo7dzy-7-vlk9d8Xf-rFD91zF1ABVaInXGii0rM Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:17:55.392754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_808dbefab4f0467c8f6ff0f18453d0b0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 28b3ce054ae04f8e9db0cdc3a13867e9 Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.394202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'c7140e32-0590-472a-a151-bd551fb262fe'} Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:17:55.394956 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.396263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.398269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Returning 404 to user: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:17:55.398269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b4f32366-5691-49d4-bdca-8d0d9929f9ab tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 404 len: 111 microversion: 2.1 time: 0.041091 Aug 24 11:17:55.398269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 495/957] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:17:55 2022] DELETE /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:17:55.405710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:55.406314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] [instance: c7140e32-0590-472a-a151-bd551fb262fe] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:17:55.415894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:55.416546 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:55.417080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:55.418051 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:17:55.418654 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:17:55.419206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:17:55.434543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] HTTP exception thrown: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Request method failure captured: Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe HTTP/1.1 Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZMk3NR_sexKwz-2gBaSftE9rFlvpuetTPgUqE5OkZk6yUJ7wbG0wVwMpdGxrBZYqYaOgigY0W1BhJ8uPmPRCw_i864x7ksGUkD2xV1oopQcuGZjDqRBmAn5edordmL3V0MaTdeEo7dzy-7-vlk9d8Xf-rFD91zF1ABVaInXGii0rM Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:17:55.436085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_808dbefab4f0467c8f6ff0f18453d0b0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/808dbefab4f0467c8f6ff0f18453d0b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 808dbefab4f0467c8f6ff0f18453d0b0 Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-402389150 Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 28b3ce054ae04f8e9db0cdc3a13867e9 Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeTestJSON-402389150-project Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.437891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'c7140e32-0590-472a-a151-bd551fb262fe'} Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:17:55.438914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. Aug 24 11:17:55.442100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:17:55.444392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] Returning 404 to user: Instance c7140e32-0590-472a-a151-bd551fb262fe could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:17:55.444392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-40e0206e-60de-42f6-8cb5-bb9fe8b8f64d tempest-AttachVolumeTestJSON-402389150 tempest-AttachVolumeTestJSON-402389150-project] 10.222.0.79 "GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe" status: 404 len: 111 microversion: 2.1 time: 0.038502 Aug 24 11:17:55.444392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 463/958] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:17:55 2022] GET /compute/v2.1/servers/c7140e32-0590-472a-a151-bd551fb262fe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:18:00.000586 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3ff112fe-567b-4fba-b6ff-39adbbc9efaa tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Action: 'create', calling method: .version_select at 0x7f82b60ab9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-259850556"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:00.324257 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3ff112fe-567b-4fba-b6ff-39adbbc9efaa tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.466973 Aug 24 11:18:00.324835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 496/959] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Aug 24 11:17:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 468 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 11:18:00.337357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0b90cab4-9061-416e-8980-ea7c40673979 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b62fde50>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:00.385872 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0b90cab4-9061-416e-8980-ea7c40673979 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58" status: 200 len: 344 microversion: 2.1 time: 0.052220 Aug 24 11:18:00.386478 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 464/960] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:18:00 2022] GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:01.400698 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-462b9a77-cb89-45d0-995c-ca64582eb488 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b61ec820>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:01.450040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-462b9a77-cb89-45d0-995c-ca64582eb488 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58" status: 200 len: 345 microversion: 2.1 time: 0.053994 Aug 24 11:18:01.450609 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 497/961] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:18:01 2022] GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:01.464475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f2915ca5-6aef-4cdb-9880-90cabe10054f tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Action: 'create', calling method: .version_select at 0x7f82baaa69d0>, body: {"snapshot": {"volume_id": "95bbb5e0-da1d-48f1-8d8e-3ac50f339b58", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1815164745"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:01.638894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f2915ca5-6aef-4cdb-9880-90cabe10054f tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.178676 Aug 24 11:18:01.643077 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 465/962] 10.222.0.79 () {60 vars in 1162 bytes} [Wed Aug 24 11:18:01 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:01.651562 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f5e71b18-b758-4245-885e-7e19186fbe43 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b60e68b0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:01.683416 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f5e71b18-b758-4245-885e-7e19186fbe43 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 200 len: 287 microversion: 2.1 time: 0.036788 Aug 24 11:18:01.683981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 498/963] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:01 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:01.695135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-185dbc08-826d-4e89-9f21-29bfeb19f264 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b6598af0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:01.725657 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-185dbc08-826d-4e89-9f21-29bfeb19f264 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034276 Aug 24 11:18:01.727068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 466/964] 10.222.0.79 () {58 vars in 1140 bytes} [Wed Aug 24 11:18:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:01.737241 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-80dade3d-32eb-4542-aab0-3a8b401ff59b tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b60ab4c0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:01.767377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-80dade3d-32eb-4542-aab0-3a8b401ff59b tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 200 len: 287 microversion: 2.1 time: 0.033915 Aug 24 11:18:01.767948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 499/965] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:01 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:02.784433 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1eeba6cc-73dc-43d8-987e-66bdc894f5f4 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b6637670>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:02.819817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1eeba6cc-73dc-43d8-987e-66bdc894f5f4 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 200 len: 287 microversion: 2.1 time: 0.042865 Aug 24 11:18:02.820377 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 467/966] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:02 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:03.836069 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cccf38dc-653e-4951-9af2-d54fb65d1bc1 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b6114790>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:03.875133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cccf38dc-653e-4951-9af2-d54fb65d1bc1 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 200 len: 287 microversion: 2.1 time: 0.043456 Aug 24 11:18:03.875811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 500/967] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:03 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:18:04.893006 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-353620c2-0309-46d8-a1cf-a7fd278803aa tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b6330550>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:04.924121 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-353620c2-0309-46d8-a1cf-a7fd278803aa tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 200 len: 287 microversion: 2.1 time: 0.037373 Aug 24 11:18:04.924677 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 468/968] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:04 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:05.602722 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=18 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:05.603743 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:05.609238 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:05.612768 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:05.622776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:05.623477 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:05.624128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:05.624882 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:05.625346 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:05.625755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:05.659835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c1f865e1-f9eb-4f00-8f8d-ff9c1dc7db5f tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058899 Aug 24 11:18:05.660260 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 501/969] 10.222.0.79 () {60 vars in 1343 bytes} [Wed Aug 24 11:18:05 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:05.720798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:05.721619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=32 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:05.727261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:05.727958 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:05.736492 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:05.736986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:05.737412 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:05.738094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:05.738544 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:05.738962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:05.764990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:18:05.844626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-62f8a183-82ac-4f0e-8077-bbb0a1f15f72 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 204 len: 0 microversion: 2.20 time: 0.124728 Aug 24 11:18:05.845214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 469/970] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 24 11:18:05 2022] DELETE /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:18:05.853952 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:05.854550 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:05.860855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:05.861329 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:05.861751 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:05.862428 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:05.862873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:05.863345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:05.937704 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ff458897-654c-4e15-bfb1-a5c82851d5fc tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b64b1f70>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:05.986282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ff458897-654c-4e15-bfb1-a5c82851d5fc tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 200 len: 288 microversion: 2.1 time: 0.052962 Aug 24 11:18:05.987036 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 470/971] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:05 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:05.997691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-89a9334c-dcf5-4d38-b2ed-7fa40905f6e9 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b6330ee0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:06.007508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:06.017298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:06.018895 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:06.020123 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-112a6ca0-58e9-459f-a3f0-319e2e52d7f2 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.170263 Aug 24 11:18:06.020740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 502/972] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:18:05 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:18:06.064882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-89a9334c-dcf5-4d38-b2ed-7fa40905f6e9 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 202 len: 0 microversion: 2.1 time: 0.070845 Aug 24 11:18:06.065459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 471/973] 10.222.0.79 () {58 vars in 1254 bytes} [Wed Aug 24 11:18:05 2022] DELETE /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:18:06.077178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ba956d03-bae9-467c-ab33-64f1f60e3ae9 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b614d310>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:06.109267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ba956d03-bae9-467c-ab33-64f1f60e3ae9 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 200 len: 287 microversion: 2.1 time: 0.037445 Aug 24 11:18:06.109843 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 503/974] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:06 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:07.049698 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:07.050405 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:07.062826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:07.063336 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:07.063758 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:07.064444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:07.064886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:07.065299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:07.125335 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-82898f3a-cd0b-48c3-8c00-62ed5cfc5a81 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b61068b0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:07.152143 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-82898f3a-cd0b-48c3-8c00-62ed5cfc5a81 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] HTTP exception thrown: Snapshot 2eecf90f-16b5-462f-ba3c-bad116324a85 could not be found. Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-82898f3a-cd0b-48c3-8c00-62ed5cfc5a81 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Request method failure captured: Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 HTTP/1.1 Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgjnT6dL750N4mIGW7rEQzBEFX0LcXe3I_2jlefQXkTChedV69mgG7vz_u7JYRndBVOx6x80WW623t4DISCfk9m9pPihQw8S4zZGSzKEWv_sjGJttS-3b8KH_tA0Gnos_K5LcaXtxmc70xaY9r3x4L2rMujEoIICRgG7uc-_kcY_-3Q Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:18:07.154685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f0aebebfb4b34c5ea83922f59923e7ca", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 7c29e8835003450ba8cf080bc092a17c Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Snapshot 2eecf90f-16b5-462f-ba3c-bad116324a85 could not be found. Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '2eecf90f-16b5-462f-ba3c-bad116324a85'} Aug 24 11:18:07.156509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2eecf90f-16b5-462f-ba3c-bad116324a85 could not be found. (HTTP 404) (Request-ID: req-5f12162f-a262-4837-bfd5-cf3f388f87e6) Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:07.157734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:18:07.159179 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2eecf90f-16b5-462f-ba3c-bad116324a85 could not be found. Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 11:18:07.160516 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2eecf90f-16b5-462f-ba3c-bad116324a85 could not be found. Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2eecf90f-16b5-462f-ba3c-bad116324a85 could not be found. Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-82898f3a-cd0b-48c3-8c00-62ed5cfc5a81 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Returning 404 to user: Snapshot 2eecf90f-16b5-462f-ba3c-bad116324a85 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-82898f3a-cd0b-48c3-8c00-62ed5cfc5a81 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85" status: 404 len: 111 microversion: 2.1 time: 0.037187 Aug 24 11:18:07.162000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 504/975] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Aug 24 11:18:07 2022] GET /compute/v2.1/os-snapshots/2eecf90f-16b5-462f-ba3c-bad116324a85 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:18:07.168545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8ff6a22f-0aa3-40e3-a69a-f63240a8c9fb tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b61ff700>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:07.209010 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:07.218218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:07.219778 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:07.221074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8a79e5c7-fe6a-4150-9cc6-a6bb5549f132 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1726 microversion: 2.20 time: 0.179699 Aug 24 11:18:07.221637 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 472/976] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:18:07 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:18:07.231210 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8ff6a22f-0aa3-40e3-a69a-f63240a8c9fb tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58" status: 202 len: 0 microversion: 2.1 time: 0.067286 Aug 24 11:18:07.231771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 505/977] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:18:07 2022] DELETE /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:18:07.241281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b7e3114e-7fe3-49b4-a1b1-4551a06fb79c tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b64b1d30>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:07.296943 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b7e3114e-7fe3-49b4-a1b1-4551a06fb79c tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58" status: 200 len: 344 microversion: 2.1 time: 0.060078 Aug 24 11:18:07.297543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 473/978] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:18:07 2022] GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:08.250207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:08.251390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:08.257963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:08.258444 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:08.258864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:08.259597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:08.260042 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:08.260512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:08.312153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6152588e-29ad-4d1e-a691-5f8bea55948b tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b62a2ee0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:08.327039 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:08.335385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:08.337118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd53266f9532a4250bf4d1159621493a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fc202cd0ae4c47ac947b30aa71e215', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:08.338270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5f1c84bb-91f2-4d41-b3de-2077968cf70a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 200 len: 1658 microversion: 2.20 time: 0.093083 Aug 24 11:18:08.339102 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 506/979] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:18:08 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 1658 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:18:08.341204 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-6152588e-29ad-4d1e-a691-5f8bea55948b tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] HTTP exception thrown: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6152588e-29ad-4d1e-a691-5f8bea55948b tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Request method failure captured: Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 HTTP/1.1 Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgjnT6dL750N4mIGW7rEQzBEFX0LcXe3I_2jlefQXkTChedV69mgG7vz_u7JYRndBVOx6x80WW623t4DISCfk9m9pPihQw8S4zZGSzKEWv_sjGJttS-3b8KH_tA0Gnos_K5LcaXtxmc70xaY9r3x4L2rMujEoIICRgG7uc-_kcY_-3Q Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:18:08.343581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f0aebebfb4b34c5ea83922f59923e7ca", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 7c29e8835003450ba8cf080bc092a17c Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '95bbb5e0-da1d-48f1-8d8e-3ac50f339b58'} Aug 24 11:18:08.345310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. (HTTP 404) (Request-ID: req-4533e45f-c1bf-4d8b-8fc2-d0536befb9b9) Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.346323 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:18:08.347802 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:18:08.349270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6152588e-29ad-4d1e-a691-5f8bea55948b tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Returning 404 to user: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:08.350990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6152588e-29ad-4d1e-a691-5f8bea55948b tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58" status: 404 len: 109 microversion: 2.1 time: 0.037406 Aug 24 11:18:08.352812 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 474/980] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:18:08 2022] GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:18:08.362277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-684aca8a-80bb-4ec6-8729-2b038fb24841 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b61ff940>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:08.393187 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-684aca8a-80bb-4ec6-8729-2b038fb24841 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] HTTP exception thrown: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-684aca8a-80bb-4ec6-8729-2b038fb24841 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Request method failure captured: Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: DELETE /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 HTTP/1.1 Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgjnT6dL750N4mIGW7rEQzBEFX0LcXe3I_2jlefQXkTChedV69mgG7vz_u7JYRndBVOx6x80WW623t4DISCfk9m9pPihQw8S4zZGSzKEWv_sjGJttS-3b8KH_tA0Gnos_K5LcaXtxmc70xaY9r3x4L2rMujEoIICRgG7uc-_kcY_-3Q Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:18:08.395181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f0aebebfb4b34c5ea83922f59923e7ca", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 7c29e8835003450ba8cf080bc092a17c Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '95bbb5e0-da1d-48f1-8d8e-3ac50f339b58'} Aug 24 11:18:08.396759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. (HTTP 404) (Request-ID: req-2696abc8-865a-4751-87cc-50147fb26425) Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.397756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:18:08.399592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:18:08.401002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-684aca8a-80bb-4ec6-8729-2b038fb24841 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Returning 404 to user: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:08.402450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-684aca8a-80bb-4ec6-8729-2b038fb24841 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58" status: 404 len: 109 microversion: 2.1 time: 0.038576 Aug 24 11:18:08.406667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5e59f491-5f60-4318-8b7d-54f52a566449 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Calling method '.version_select at 0x7f82b65981f0>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:08.412402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 507/981] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:18:08 2022] DELETE /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:18:08.436578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-5e59f491-5f60-4318-8b7d-54f52a566449 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] HTTP exception thrown: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5e59f491-5f60-4318-8b7d-54f52a566449 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Request method failure captured: Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 HTTP/1.1 Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgjnT6dL750N4mIGW7rEQzBEFX0LcXe3I_2jlefQXkTChedV69mgG7vz_u7JYRndBVOx6x80WW623t4DISCfk9m9pPihQw8S4zZGSzKEWv_sjGJttS-3b8KH_tA0Gnos_K5LcaXtxmc70xaY9r3x4L2rMujEoIICRgG7uc-_kcY_-3Q Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:18:08.438817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f0aebebfb4b34c5ea83922f59923e7ca", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f0aebebfb4b34c5ea83922f59923e7ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f0aebebfb4b34c5ea83922f59923e7ca Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-190857722 Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 7c29e8835003450ba8cf080bc092a17c Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-190857722-project Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '95bbb5e0-da1d-48f1-8d8e-3ac50f339b58'} Aug 24 11:18:08.440241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. (HTTP 404) (Request-ID: req-c36be5a6-7831-4465-84a2-b2db0f4fb47d) Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.441049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:18:08.442246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:18:08.443595 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-5e59f491-5f60-4318-8b7d-54f52a566449 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] Returning 404 to user: Volume 95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-5e59f491-5f60-4318-8b7d-54f52a566449 tempest-VolumesSnapshotsTestJSON-190857722 tempest-VolumesSnapshotsTestJSON-190857722-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58" status: 404 len: 109 microversion: 2.1 time: 0.038724 Aug 24 11:18:08.445314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 475/982] 10.222.0.79 () {58 vars in 1245 bytes} [Wed Aug 24 11:18:08 2022] GET /compute/v2.1/os-volumes/95bbb5e0-da1d-48f1-8d8e-3ac50f339b58 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:18:08.549162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-4b37db79-e7aa-41bb-b8f6-58461871ad69 req-32c3234b-ec5e-4126-9953-667e24bf48a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12fb1be-eff8-42a1-9818-6cf5681c6917", "name": "network-vif-deleted", "tag": "db943507-5258-4e45-8aaa-0ce5bc112e88"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:08.559915 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-4b37db79-e7aa-41bb-b8f6-58461871ad69 req-32c3234b-ec5e-4126-9953-667e24bf48a9 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:08.560415 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-4b37db79-e7aa-41bb-b8f6-58461871ad69 req-32c3234b-ec5e-4126-9953-667e24bf48a9 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:08.560834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-4b37db79-e7aa-41bb-b8f6-58461871ad69 req-32c3234b-ec5e-4126-9953-667e24bf48a9 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:08.579128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-4b37db79-e7aa-41bb-b8f6-58461871ad69 req-32c3234b-ec5e-4126-9953-667e24bf48a9 service nova] Creating event network-vif-deleted:db943507-5258-4e45-8aaa-0ce5bc112e88 for instance a12fb1be-eff8-42a1-9818-6cf5681c6917 on hv-cinder-85427 Aug 24 11:18:08.584448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-4b37db79-e7aa-41bb-b8f6-58461871ad69 req-32c3234b-ec5e-4126-9953-667e24bf48a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107774 Aug 24 11:18:08.585051 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 508/983] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:09.364851 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:09.365458 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:09.379639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:09.380135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:09.380560 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:09.381266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:09.382066 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:09.382655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:09.398813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] HTTP exception thrown: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Request method failure captured: Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 HTTP/1.1 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZOn0Ds_E8WFOk5eJo3i-rp3WVuuO-EJK1TcA9fB3LZkmdgRrMlI3JJHV_7GnZLSenv8-SzbWcZ7CJNgavuStXRk7lnLYrM0PiRr4ZAIdoo8VYeUeDus92L4AqsaFfkXijgRfaYqeYMy4aLFnApvZLlLty1DEDdgSFjhl5BRzJk0l8 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:18:09.400401 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_89fc202cd0ae4c47ac947b30aa71e215", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: d53266f9532a4250bf4d1159621493a9 Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:09.402137 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'a12fb1be-eff8-42a1-9818-6cf5681c6917'} Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:09.403498 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:09.405021 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:09.406633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Returning 404 to user: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:09.406633 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-357265d8-dcc2-46f4-a216-c35d195b1b15 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 404 len: 111 microversion: 2.20 time: 0.042556 Aug 24 11:18:09.411132 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 476/984] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:18:09 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:18:09.412397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-781596c8-d7ff-4c33-abcb-3971d4ed9b19 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '.version_select at 0x7f82b6106280>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:09.437786 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-781596c8-d7ff-4c33-abcb-3971d4ed9b19 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653145090" status: 204 len: 0 microversion: 2.20 time: 0.029186 Aug 24 11:18:09.439084 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 509/985] 10.222.0.79 () {60 vars in 1262 bytes} [Wed Aug 24 11:18:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653145090 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:18:11.233815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:11.234427 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:11.241085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:11.241569 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:11.242000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:11.242684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:11.243380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:11.243801 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:11.258227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] HTTP exception thrown: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Request method failure captured: Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 HTTP/1.1 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZOn0Ds_E8WFOk5eJo3i-rp3WVuuO-EJK1TcA9fB3LZkmdgRrMlI3JJHV_7GnZLSenv8-SzbWcZ7CJNgavuStXRk7lnLYrM0PiRr4ZAIdoo8VYeUeDus92L4AqsaFfkXijgRfaYqeYMy4aLFnApvZLlLty1DEDdgSFjhl5BRzJk0l8 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:18:11.259818 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_89fc202cd0ae4c47ac947b30aa71e215", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: d53266f9532a4250bf4d1159621493a9 Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.261353 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'a12fb1be-eff8-42a1-9818-6cf5681c6917'} Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:11.265366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.266645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.268999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Returning 404 to user: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:11.268999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6438aedc-fa62-4ab3-be3e-0bc35f574d6d tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 404 len: 111 microversion: 2.20 time: 0.031805 Aug 24 11:18:11.268999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 477/986] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 24 11:18:11 2022] DELETE /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:18:11.269894 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:11.270587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: a12fb1be-eff8-42a1-9818-6cf5681c6917] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:11.278398 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:11.278868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:11.279319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:11.280026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:11.280558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:11.281228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:11.297771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] HTTP exception thrown: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Request method failure captured: Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 HTTP/1.1 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZOn0Ds_E8WFOk5eJo3i-rp3WVuuO-EJK1TcA9fB3LZkmdgRrMlI3JJHV_7GnZLSenv8-SzbWcZ7CJNgavuStXRk7lnLYrM0PiRr4ZAIdoo8VYeUeDus92L4AqsaFfkXijgRfaYqeYMy4aLFnApvZLlLty1DEDdgSFjhl5BRzJk0l8 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:18:11.299458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_89fc202cd0ae4c47ac947b30aa71e215", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: d53266f9532a4250bf4d1159621493a9 Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.300914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'a12fb1be-eff8-42a1-9818-6cf5681c6917'} Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:11.301689 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. Aug 24 11:18:11.302938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:11.304098 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Returning 404 to user: Instance a12fb1be-eff8-42a1-9818-6cf5681c6917 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:11.304098 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-559998df-9337-4ed3-997b-1a3253714505 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917" status: 404 len: 111 microversion: 2.20 time: 0.034849 Aug 24 11:18:11.304098 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 510/987] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:18:11 2022] GET /compute/v2.1/servers/a12fb1be-eff8-42a1-9818-6cf5681c6917 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:18:12.450345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:12.450861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:12.457273 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:12.457862 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:12.458291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:12.458987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:12.459458 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:12.459876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:12.474415 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] HTTP exception thrown: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Request method failure captured: Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc HTTP/1.1 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgZOn0Ds_E8WFOk5eJo3i-rp3WVuuO-EJK1TcA9fB3LZkmdgRrMlI3JJHV_7GnZLSenv8-SzbWcZ7CJNgavuStXRk7lnLYrM0PiRr4ZAIdoo8VYeUeDus92L4AqsaFfkXijgRfaYqeYMy4aLFnApvZLlLty1DEDdgSFjhl5BRzJk0l8 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:18:12.475866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_89fc202cd0ae4c47ac947b30aa71e215", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: d53266f9532a4250bf4d1159621493a9 Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.477524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '2e7358f8-2cd1-41ac-a439-4630ad8630bc'} Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:12.478327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.479711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.481197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Returning 404 to user: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:12.481197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-95186cc4-dd76-4e9e-9371-7c2bd0f45217 tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 404 len: 111 microversion: 2.20 time: 0.030843 Aug 24 11:18:12.481197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 478/988] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Aug 24 11:18:12 2022] DELETE /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 11:18:12.485724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:12.486358 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] [instance: 2e7358f8-2cd1-41ac-a439-4630ad8630bc] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:12.492352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:12.492814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:12.493233 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:12.493900 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:12.494331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:12.494732 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:12.508225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] HTTP exception thrown: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Request method failure captured: Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc HTTP/1.1 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgZOn0Ds_E8WFOk5eJo3i-rp3WVuuO-EJK1TcA9fB3LZkmdgRrMlI3JJHV_7GnZLSenv8-SzbWcZ7CJNgavuStXRk7lnLYrM0PiRr4ZAIdoo8VYeUeDus92L4AqsaFfkXijgRfaYqeYMy4aLFnApvZLlLty1DEDdgSFjhl5BRzJk0l8 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:18:12.509738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_89fc202cd0ae4c47ac947b30aa71e215", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/89fc202cd0ae4c47ac947b30aa71e215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 89fc202cd0ae4c47ac947b30aa71e215 Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289420715 Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: d53266f9532a4250bf4d1159621493a9 Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289420715-project Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.511368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '2e7358f8-2cd1-41ac-a439-4630ad8630bc'} Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:12.512118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. Aug 24 11:18:12.513370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.514473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] Returning 404 to user: Instance 2e7358f8-2cd1-41ac-a439-4630ad8630bc could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:12.514473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f0c57f84-3f0d-4022-b8d5-97d91be7e13a tempest-AttachVolumeShelveTestJSON-1289420715 tempest-AttachVolumeShelveTestJSON-1289420715-project] 10.222.0.79 "GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc" status: 404 len: 111 microversion: 2.20 time: 0.029326 Aug 24 11:18:12.514473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 511/989] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Aug 24 11:18:12 2022] GET /compute/v2.1/servers/2e7358f8-2cd1-41ac-a439-4630ad8630bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:18:21.851266 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-83d3ba4a-c865-4e6a-9103-da60c871cc50 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: .version_select at 0x7f82b63420d0>, body: {"keypair": {"name": "tempest-keypair-2016231801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRRm13SQBFcOYwL0CcDcoWCga+kIyPDRVev2guD7ALnuoNvMxb0QfdCreBznYMwgM0g7mmJA8UNzGOh422x4z9mYgEw9F2w/zoZ5Y7eaYQz+7vlwEurU9e2E+wzU9u8kw=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:21.867115 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-83d3ba4a-c865-4e6a-9103-da60c871cc50 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:18:21.871015 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-83d3ba4a-c865-4e6a-9103-da60c871cc50 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:18:21.884397 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83d3ba4a-c865-4e6a-9103-da60c871cc50 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:18:22.465080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:22.893232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [None req-83d3ba4a-c865-4e6a-9103-da60c871cc50 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 47114. Aug 24 11:18:22.917361 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-83d3ba4a-c865-4e6a-9103-da60c871cc50 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.188248 Aug 24 11:18:22.917959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 479/990] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:18:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:24.556656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1546889994", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eded3bd1-408f-4f99-aa7f-088156d1dc13"}], "security_groups": [{"name": "tempest-securitygroup--332296230"}], "key_name": "tempest-keypair-2016231801", "user_data": "}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:24.568542 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:24.569976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=24 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:24.735726 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] validate_networks() for [('eded3bd1-408f-4f99-aa7f-088156d1dc13', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:18:25.241161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:18:25.241576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:18:25.242262 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:18:25.242665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:18:25.243080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:18:25.252175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:25.252657 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:25.253098 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:25.253796 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:25.254237 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:25.254654 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:25.272646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:18:25.277569 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:18:25.289592 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:18:25.292463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:18:25.361478 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-95712c18-3d4e-42e6-af01-a8867937e34f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.809285 Aug 24 11:18:25.365245 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 512/991] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:18:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:18:25.376159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f6008de7-5be6-4fd7-92d7-b9c56716c7c2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:25.376739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f6008de7-5be6-4fd7-92d7-b9c56716c7c2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:25.441449 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f6008de7-5be6-4fd7-92d7-b9c56716c7c2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:25.451156 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f6008de7-5be6-4fd7-92d7-b9c56716c7c2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1242 microversion: 2.1 time: 0.078998 Aug 24 11:18:25.452321 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 480/992] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:25 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:18:26.473089 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:26.474361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:26.481711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:26.482271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:26.482931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:26.483905 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:26.485465 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:26.486144 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:26.565324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:26.574742 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5be0ae3c-72b9-4414-ac07-ac9b6ba5166f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1302 microversion: 2.1 time: 0.106222 Aug 24 11:18:26.575702 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 513/993] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:26 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1302 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:27.597100 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:27.597697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:27.604542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:27.605122 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:27.605623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:27.606389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:27.606841 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:27.607283 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:27.750123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:27.765182 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8cd09d45-15f3-4286-92a2-646fcce1f66b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.173485 Aug 24 11:18:27.779399 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 481/994] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:27 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:27.938382 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-dfe54229-7072-49fe-9cde-cc8c7ee726ca req-0c353480-e848-4dd3-8dea-8dbd581268e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f26c942d-aa42-4377-9637-c5c426bd3a9e", "tag": "80fd0a36-77ea-41ee-8a00-c32913bbcdc7"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:27.971078 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-dfe54229-7072-49fe-9cde-cc8c7ee726ca req-0c353480-e848-4dd3-8dea-8dbd581268e2 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:27.971876 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-dfe54229-7072-49fe-9cde-cc8c7ee726ca req-0c353480-e848-4dd3-8dea-8dbd581268e2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:27.972520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-dfe54229-7072-49fe-9cde-cc8c7ee726ca req-0c353480-e848-4dd3-8dea-8dbd581268e2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:27.991781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-dfe54229-7072-49fe-9cde-cc8c7ee726ca req-0c353480-e848-4dd3-8dea-8dbd581268e2 service nova] Creating event network-changed:80fd0a36-77ea-41ee-8a00-c32913bbcdc7 for instance f26c942d-aa42-4377-9637-c5c426bd3a9e on hv-cinder-85427 Aug 24 11:18:28.010295 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-dfe54229-7072-49fe-9cde-cc8c7ee726ca req-0c353480-e848-4dd3-8dea-8dbd581268e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065447 Aug 24 11:18:28.011518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 514/995] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:28.792029 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:28.793215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:28.803252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:28.804058 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:28.804797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:28.806276 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:28.807420 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:28.807745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:28.943243 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:28.950759 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-006115e4-c74b-4e28-999b-961158c272b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.165666 Aug 24 11:18:28.951339 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 482/996] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:28 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:29.977662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:29.978742 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:29.987641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:29.988132 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:29.988551 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:29.989225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:29.989698 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:29.990360 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:30.361086 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:30.368948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-15629841-739b-49f2-a823-158574f8310d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.399263 Aug 24 11:18:30.369508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 515/997] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:29 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:31.392736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:31.393994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:31.400474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:31.400950 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:31.401381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:31.402062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:31.402510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:31.402927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:31.540665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:31.552676 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e72a11d1-fe1f-4eb6-ba78-bb3c41804b23 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.165274 Aug 24 11:18:31.553376 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 483/998] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:31 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:32.580906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:32.581760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:32.592804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:32.593492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:32.593938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:32.594647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:32.595101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:32.595544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:32.732124 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:32.740576 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-99b65d27-c014-4fde-bf4d-2602556479ac tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.166511 Aug 24 11:18:32.741122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 516/999] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:32 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:33.771717 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:33.772570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:33.782709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:33.783219 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:33.783645 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:33.784335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:33.784780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:33.785198 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:33.918787 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:33.926720 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7f30ac37-51c0-46d0-96fc-ddcdeaa267b2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.161239 Aug 24 11:18:33.927343 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 484/1000] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:33 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:34.951716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:34.952836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:34.959538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:34.960024 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:34.960447 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:34.961106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:34.961551 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:34.961963 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:35.108873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:35.117590 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ec06b4f6-753c-4b33-9ef9-a755f9fd5360 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.172228 Aug 24 11:18:35.118174 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 517/1001] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:34 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:36.003771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:36.128471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-627ac508-397b-43f9-a2f8-ec6673bb0b4d req-e86a65ab-3b06-4b11-9e28-70aba8bbc392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26c942d-aa42-4377-9637-c5c426bd3a9e", "name": "network-vif-plugged", "status": "completed", "tag": "80fd0a36-77ea-41ee-8a00-c32913bbcdc7"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:36.133292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:36.140987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-627ac508-397b-43f9-a2f8-ec6673bb0b4d req-e86a65ab-3b06-4b11-9e28-70aba8bbc392 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:36.141879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-627ac508-397b-43f9-a2f8-ec6673bb0b4d req-e86a65ab-3b06-4b11-9e28-70aba8bbc392 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:36.142117 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-627ac508-397b-43f9-a2f8-ec6673bb0b4d req-e86a65ab-3b06-4b11-9e28-70aba8bbc392 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:36.143590 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:36.144359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:36.146470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:36.147333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:36.154536 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-627ac508-397b-43f9-a2f8-ec6673bb0b4d req-e86a65ab-3b06-4b11-9e28-70aba8bbc392 service nova] Creating event network-vif-plugged:80fd0a36-77ea-41ee-8a00-c32913bbcdc7 for instance f26c942d-aa42-4377-9637-c5c426bd3a9e on hv-cinder-85427 Aug 24 11:18:36.155225 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:36.156107 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:36.156236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:36.157005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:36.157438 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:36.158272 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:36.159864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-627ac508-397b-43f9-a2f8-ec6673bb0b4d req-e86a65ab-3b06-4b11-9e28-70aba8bbc392 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163132 Aug 24 11:18:36.160507 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 485/1002] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:36.297049 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:36.305870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fa930bec-7863-4134-8df5-ece1ca01fbf1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.168047 Aug 24 11:18:36.306578 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 518/1003] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:36 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:37.328937 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:37.329979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:37.337151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:37.337819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:37.338247 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:37.339151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:37.339790 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:37.340496 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:37.476641 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:37.484630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-38aa76f0-f38c-4e8a-bfa8-d80f80b8f810 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1367 microversion: 2.1 time: 0.161442 Aug 24 11:18:37.485195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 486/1004] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:37 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:38.504713 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:38.505311 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:38.511957 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:38.512429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:38.512847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:38.513525 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:38.513970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:38.514378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:38.648750 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:18:38.656575 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c07603b7-09a8-4ec2-a2d2-a9dcf423bbbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1556 microversion: 2.1 time: 0.155839 Aug 24 11:18:38.657136 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 519/1005] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:18:38 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:18:38.676982 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:38.677543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:18:38.683909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:38.684385 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:38.684813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:38.685495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:38.686138 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:38.686786 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:38.776134 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aaf22dd0-1039-41a8-af91-0c3a56643d82 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103026 Aug 24 11:18:38.776938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 487/1006] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:18:38 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:39.759439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-a41b8c24-d507-49a1-9ad6-a5f292b5d6c5 req-3011941d-0b56-4b96-beb4-4c79e23d080e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f26c942d-aa42-4377-9637-c5c426bd3a9e", "tag": "80fd0a36-77ea-41ee-8a00-c32913bbcdc7"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:39.772245 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a41b8c24-d507-49a1-9ad6-a5f292b5d6c5 req-3011941d-0b56-4b96-beb4-4c79e23d080e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:18:39.773543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a41b8c24-d507-49a1-9ad6-a5f292b5d6c5 req-3011941d-0b56-4b96-beb4-4c79e23d080e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:18:39.774418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a41b8c24-d507-49a1-9ad6-a5f292b5d6c5 req-3011941d-0b56-4b96-beb4-4c79e23d080e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:18:39.790661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-a41b8c24-d507-49a1-9ad6-a5f292b5d6c5 req-3011941d-0b56-4b96-beb4-4c79e23d080e service nova] Creating event network-changed:80fd0a36-77ea-41ee-8a00-c32913bbcdc7 for instance f26c942d-aa42-4377-9637-c5c426bd3a9e on hv-cinder-85427 Aug 24 11:18:39.796711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-a41b8c24-d507-49a1-9ad6-a5f292b5d6c5 req-3011941d-0b56-4b96-beb4-4c79e23d080e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041699 Aug 24 11:18:39.798263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 520/1007] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:58.103754 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=5 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:58.104615 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=36 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:58.109787 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:58.110329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:58.117242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:58.117717 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:58.118143 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:58.118819 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:58.119290 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:58.119701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:58.143017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-047273f0-4b81-4661-a141-6c8ce0903ece tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/ips" status: 200 len: 149 microversion: 2.1 time: 0.041911 Aug 24 11:19:58.143623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 488/1008] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:19:58 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:59.561675 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:59.563526 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=42 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:59.568354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "905e0267-79eb-40d3-b3f8-0032a6bda7b3"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:19:59.571721 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:19:59.581310 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:59.581788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:59.582223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:59.582904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:19:59.583385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:19:59.583802 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:19:59.837681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-784de25b-1e76-45bc-9749-f2971f8ec68a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279071 Aug 24 11:19:59.838289 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 521/1009] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:19:59 2022] POST /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:07.449471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0a858835-6edf-43e9-95c3-aa8083702bbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: .version_select at 0x7f82baab8670>, body: {"keypair": {"name": "tempest-keypair-2020492736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOi5hBwuLy97PgQh9r5qVjCrOleO4aCQFC4866kHyH8FPOKXSPlLC4nGPKJfHfQptvQ+Oe67V0DVPmPLoZNTqqBAbedRy1DqnQanmaWlF4PgqaNotslFca+6nhv/Q+P2g=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:07.466452 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-0a858835-6edf-43e9-95c3-aa8083702bbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:20:07.470567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-0a858835-6edf-43e9-95c3-aa8083702bbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:20:07.494567 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0a858835-6edf-43e9-95c3-aa8083702bbf tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048976 Aug 24 11:20:07.495168 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 489/1010] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:20:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:08.822093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1831286666", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eded3bd1-408f-4f99-aa7f-088156d1dc13"}], "security_groups": [{"name": "tempest-securitygroup--2053562350"}], "key_name": "tempest-keypair-2020492736", "user_data": "}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:08.932418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] validate_networks() for [('eded3bd1-408f-4f99-aa7f-088156d1dc13', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:20:09.459012 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:20:09.459452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:20:09.459915 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:20:09.460317 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:20:09.460717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:20:09.470512 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:09.470988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:09.471452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:09.472166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:09.472597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:09.473027 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:09.491394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:20:09.495492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:20:09.507760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:20:09.510112 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:20:09.563554 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-892e34f5-bb95-4727-a288-1f8218092dc8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746424 Aug 24 11:20:09.564282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 522/1011] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:20:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:20:09.573542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:09.578124 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0079106a-932e-4f9c-a084-74cbbca42e4c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:09.578750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0079106a-932e-4f9c-a084-74cbbca42e4c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:09.641923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0079106a-932e-4f9c-a084-74cbbca42e4c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:09.649469 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0079106a-932e-4f9c-a084-74cbbca42e4c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1242 microversion: 2.1 time: 0.076667 Aug 24 11:20:09.650035 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 490/1012] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:09 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:10.670587 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fba5f1f6-a349-40a8-bfcc-d18d80282947 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:10.671440 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fba5f1f6-a349-40a8-bfcc-d18d80282947 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:10.734356 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fba5f1f6-a349-40a8-bfcc-d18d80282947 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:10.741834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fba5f1f6-a349-40a8-bfcc-d18d80282947 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1242 microversion: 2.1 time: 0.075161 Aug 24 11:20:10.742396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 523/1013] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:10 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:11.761667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-8c46c094-ab5a-49d5-b234-cc6b4a16e40b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:11.762272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-8c46c094-ab5a-49d5-b234-cc6b4a16e40b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:11.815607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-8c46c094-ab5a-49d5-b234-cc6b4a16e40b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:11.822984 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-8c46c094-ab5a-49d5-b234-cc6b4a16e40b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1242 microversion: 2.1 time: 0.065238 Aug 24 11:20:11.823589 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 491/1014] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:11 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:12.846493 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1b330b31-ae51-4e80-ac13-439bc2193570 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:12.847753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1b330b31-ae51-4e80-ac13-439bc2193570 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:12.849392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:20:12.850454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:20:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:20:12.906261 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1b330b31-ae51-4e80-ac13-439bc2193570 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:12.913868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1b330b31-ae51-4e80-ac13-439bc2193570 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1242 microversion: 2.1 time: 0.072448 Aug 24 11:20:12.914421 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 524/1015] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:12 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:13.937846 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:13.938455 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:13.945808 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:13.946280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:13.946700 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:13.947414 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:13.947856 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:13.948269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:14.019223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:14.033606 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ac68545f-f82b-40c5-a8c2-86de623c3a12 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1246 microversion: 2.1 time: 0.101902 Aug 24 11:20:14.034454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 492/1016] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:13 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:15.059295 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:15.059847 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:15.067463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:15.067976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:15.068441 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:15.069276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:15.069729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:15.070189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:15.132763 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:15.140967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3654a992-0662-4501-93f4-b6567c3008ca tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1300 microversion: 2.1 time: 0.085472 Aug 24 11:20:15.141520 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 525/1017] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:15 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:16.162463 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:16.163093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:16.170022 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:16.170501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:16.170930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:16.172275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:16.172739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:16.173171 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:16.313026 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:16.319612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-3e24165d-bb60-411b-ab04-cf5a010e0a06 req-81aa1c62-24c0-401d-a15f-3844e0d980fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7fe433-804a-4110-bb00-5c02bd4f0222", "tag": "62451b87-1a55-4dc5-8531-0103b880dc90"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:16.323798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b020e30e-1a41-4a42-a425-f3e88e93dc6f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1368 microversion: 2.1 time: 0.165154 Aug 24 11:20:16.324529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 493/1018] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:16 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:16.334019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-3e24165d-bb60-411b-ab04-cf5a010e0a06 req-81aa1c62-24c0-401d-a15f-3844e0d980fa service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:16.334495 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-3e24165d-bb60-411b-ab04-cf5a010e0a06 req-81aa1c62-24c0-401d-a15f-3844e0d980fa service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:16.334918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-3e24165d-bb60-411b-ab04-cf5a010e0a06 req-81aa1c62-24c0-401d-a15f-3844e0d980fa service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:16.350259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-3e24165d-bb60-411b-ab04-cf5a010e0a06 req-81aa1c62-24c0-401d-a15f-3844e0d980fa service nova] Creating event network-changed:62451b87-1a55-4dc5-8531-0103b880dc90 for instance bb7fe433-804a-4110-bb00-5c02bd4f0222 on hv-cinder-85427 Aug 24 11:20:16.355381 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-3e24165d-bb60-411b-ab04-cf5a010e0a06 req-81aa1c62-24c0-401d-a15f-3844e0d980fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040015 Aug 24 11:20:16.355953 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 526/1019] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:17.349936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:17.350993 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:17.361004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:17.361486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:17.361914 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:17.362592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:17.363040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:17.363490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:17.510503 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:17.526325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-1f3b05f8-fd1c-4725-811a-210bb381fc9c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1368 microversion: 2.1 time: 0.183044 Aug 24 11:20:17.527975 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 494/1020] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:17 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:18.554082 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:18.555201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:18.566825 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:18.567668 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:18.568393 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:18.569519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:18.570236 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:18.570959 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:18.740572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:18.748487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2fc81946-6934-46e0-9757-f66246cdec88 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1368 microversion: 2.1 time: 0.201634 Aug 24 11:20:18.749050 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 527/1021] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:18 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:19.780216 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:19.781559 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:19.788136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:19.788610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:19.789056 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:19.789721 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:19.790166 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:19.790576 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:19.936025 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:19.945101 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4423cf42-1848-4553-9e23-4df065f2c18c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1368 microversion: 2.1 time: 0.171150 Aug 24 11:20:19.945668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 495/1022] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:19 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:20.969604 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:20.970455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:20.973385 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:20.981925 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:20.982661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:20.983366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:20.984308 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:20.984776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:20.985189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:21.127273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:21.139961 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4fc6c618-0e47-44e5-92c2-b5149c22c3af tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1368 microversion: 2.1 time: 0.176550 Aug 24 11:20:21.141030 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 528/1023] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:20 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:22.167911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:22.168551 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:22.173019 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=8 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:22.182384 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:22.183226 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:22.184241 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:22.185429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:22.186237 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:22.187503 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:22.294075 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-57956550-48c2-40d1-b840-8092c33cbc47 req-c66ab810-1332-4151-8763-33f93fbeebaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7fe433-804a-4110-bb00-5c02bd4f0222", "name": "network-vif-plugged", "status": "completed", "tag": "62451b87-1a55-4dc5-8531-0103b880dc90"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:22.304838 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-57956550-48c2-40d1-b840-8092c33cbc47 req-c66ab810-1332-4151-8763-33f93fbeebaa service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:22.305417 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-57956550-48c2-40d1-b840-8092c33cbc47 req-c66ab810-1332-4151-8763-33f93fbeebaa service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:22.305838 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-57956550-48c2-40d1-b840-8092c33cbc47 req-c66ab810-1332-4151-8763-33f93fbeebaa service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:22.318936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-57956550-48c2-40d1-b840-8092c33cbc47 req-c66ab810-1332-4151-8763-33f93fbeebaa service nova] Creating event network-vif-plugged:62451b87-1a55-4dc5-8531-0103b880dc90 for instance bb7fe433-804a-4110-bb00-5c02bd4f0222 on hv-cinder-85427 Aug 24 11:20:22.324472 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-57956550-48c2-40d1-b840-8092c33cbc47 req-c66ab810-1332-4151-8763-33f93fbeebaa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033970 Aug 24 11:20:22.325086 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 529/1024] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:20:22.328934 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:22.337899 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2dc95b91-cc49-4dbf-9bf4-92c58e412e8f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1368 microversion: 2.1 time: 0.174171 Aug 24 11:20:22.338897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 496/1025] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:22 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:23.361286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=10 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:23.367669 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:23.368647 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:23.377416 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:23.377903 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:23.378332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:23.379020 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:23.379500 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:23.379918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:23.514997 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:23.526630 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e5d2f861-c252-4d2b-92db-550aa0cf9188 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1368 microversion: 2.1 time: 0.166497 Aug 24 11:20:23.527442 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 530/1026] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:23 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:24.004880 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:24.005737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:24.016579 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.017063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.017494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.018179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.018635 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.019071 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.047843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:20:24.133945 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-53034806-a478-46eb-a69f-0b71f7c25616 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 204 len: 0 microversion: 2.1 time: 0.135987 Aug 24 11:20:24.135477 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 497/1027] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:20:23 2022] DELETE /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:20:24.143533 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:24.144124 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:24.152937 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.153728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.154457 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.155327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.155844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.156424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.296170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:24.304114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7e1a01db-4fa8-4ebe-be4f-844c9f6aad3e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1577 microversion: 2.1 time: 0.164528 Aug 24 11:20:24.304679 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 531/1028] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:24 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:24.553693 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:24.555015 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:24.565208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.565987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.566954 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.568117 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.569050 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.569737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.731081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:24.742103 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-03acfd81-f0ae-49c1-811a-e04b3e94ecc1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1557 microversion: 2.1 time: 0.195237 Aug 24 11:20:24.742815 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 498/1029] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:24 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:24.768552 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:24.769125 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:24.776168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.776645 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.777067 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.777747 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:24.778191 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:24.778605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:24.858481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-792c264c-0506-437e-8fe8-da930c596a0c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093831 Aug 24 11:20:24.859321 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 532/1030] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:20:24 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:25.326062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:25.326671 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:25.333750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:25.334268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:25.334706 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:25.335434 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:25.335885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:25.336299 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:25.824731 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:25.834459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-24dd1c22-1408-496a-8b8f-99e61766a70f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1577 microversion: 2.1 time: 0.512370 Aug 24 11:20:25.847080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 499/1031] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:25 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1577 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:26.247155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-01030ef9-5e1c-41bd-8e47-5a1c36ebb081 req-2a8f0006-7a8c-4556-835c-dd56f3055b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7fe433-804a-4110-bb00-5c02bd4f0222", "tag": "62451b87-1a55-4dc5-8531-0103b880dc90"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:26.257152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-01030ef9-5e1c-41bd-8e47-5a1c36ebb081 req-2a8f0006-7a8c-4556-835c-dd56f3055b5f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:26.257594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-01030ef9-5e1c-41bd-8e47-5a1c36ebb081 req-2a8f0006-7a8c-4556-835c-dd56f3055b5f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:26.258036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-01030ef9-5e1c-41bd-8e47-5a1c36ebb081 req-2a8f0006-7a8c-4556-835c-dd56f3055b5f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:26.270926 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-01030ef9-5e1c-41bd-8e47-5a1c36ebb081 req-2a8f0006-7a8c-4556-835c-dd56f3055b5f service nova] Creating event network-changed:62451b87-1a55-4dc5-8531-0103b880dc90 for instance bb7fe433-804a-4110-bb00-5c02bd4f0222 on hv-cinder-85427 Aug 24 11:20:26.276293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-01030ef9-5e1c-41bd-8e47-5a1c36ebb081 req-2a8f0006-7a8c-4556-835c-dd56f3055b5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160927 Aug 24 11:20:26.277319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 533/1032] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:26.777555 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-3a26d829-a920-4dbb-a2e4-2e320da493d9 req-f3d98c12-55b8-4c21-bfce-ff9eaac636a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e7a1e2-de96-447d-b786-d19bd604b744", "name": "network-vif-deleted", "tag": "8093798d-0cbc-44fa-9a51-b7647671e836"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:26.801083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3a26d829-a920-4dbb-a2e4-2e320da493d9 req-f3d98c12-55b8-4c21-bfce-ff9eaac636a2 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:26.801598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3a26d829-a920-4dbb-a2e4-2e320da493d9 req-f3d98c12-55b8-4c21-bfce-ff9eaac636a2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:26.802010 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-3a26d829-a920-4dbb-a2e4-2e320da493d9 req-f3d98c12-55b8-4c21-bfce-ff9eaac636a2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:26.848058 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-3a26d829-a920-4dbb-a2e4-2e320da493d9 req-f3d98c12-55b8-4c21-bfce-ff9eaac636a2 service nova] Creating event network-vif-deleted:8093798d-0cbc-44fa-9a51-b7647671e836 for instance 69e7a1e2-de96-447d-b786-d19bd604b744 on hv-cinder-85427 Aug 24 11:20:26.857209 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:26.858070 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:26.872665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-3a26d829-a920-4dbb-a2e4-2e320da493d9 req-f3d98c12-55b8-4c21-bfce-ff9eaac636a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099344 Aug 24 11:20:26.873256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:26.874323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:26.874958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:26.875701 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 500/1033] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:26.876890 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:26.877354 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:26.877773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:26.975223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:26.983671 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d91e7974-747a-47f9-b966-6134af1cc5b2 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 200 len: 1225 microversion: 2.1 time: 0.131289 Aug 24 11:20:26.984696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 534/1034] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:26 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:20:28.005959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:28.006670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:28.013432 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:28.013927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:28.014362 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:28.015640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:28.016116 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:28.016531 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:28.030897 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] HTTP exception thrown: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Request method failure captured: Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 HTTP/1.1 Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBginuYasCxz_wgDBkGW2KjBN_pJxdcDPJonHLJGmBou2xe_29MgcTpaA7EZ-8w8ETeJCcen7hRkQaZLKwEbRqRvhMZF5qzqVZAqLv4XcE4nO1HZCrGpHLZ0bir5-MZEg87jOiKBpBfvZ99KNb9kjhpe06ySK35rWUst9lZ9FlrXEPqw Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:20:28.033451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46fb2a59ebfe4b8eb4395b2281885b6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: c671384bbcc7405b85856efbc8dde5de Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:20:28.035162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '69e7a1e2-de96-447d-b786-d19bd604b744'} Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:20:28.036176 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:20:28.037826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:20:28.039280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Returning 404 to user: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:20:28.039280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bb74c495-92ac-4585-99ec-14ff72a5ca7e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 404 len: 111 microversion: 2.1 time: 0.033723 Aug 24 11:20:28.039280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 501/1035] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:27 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:20:28.143470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-843221087", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2091664764", "security_groups": [{"name": "tempest-secgroup-smoke-533430042"}], "block_device_mapping_v2": [{"uuid": "3bbdc01c-54e1-45ab-ab12-38f9a17a043b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "843628f4-43b9-4b8d-9051-b767617bbe5b"}]}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:28.261736 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] validate_networks() for [('843628f4-43b9-4b8d-9051-b767617bbe5b', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:20:28.810193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:20:28.810836 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:20:28.811567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:20:28.812428 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:20:28.812772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:20:28.826348 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:28.826995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:28.827724 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:28.828506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:28.829063 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:28.829535 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:28.851455 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:20:28.855938 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for user c671384bbcc7405b85856efbc8dde5de and project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:20:28.927463 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:20:28.930811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3bbdc01c-54e1-45ab-ab12-38f9a17a043b',volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:20:29.083337 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b29d69e4-0faf-4a20-b944-4f4ff1b82b27 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.943592 Aug 24 11:20:29.084080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 535/1036] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:20:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:20:29.094839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bbe876bd-6cf9-40c3-bb54-d5125e5453a7 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:29.095461 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bbe876bd-6cf9-40c3-bb54-d5125e5453a7 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:29.098795 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:29.151079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bbe876bd-6cf9-40c3-bb54-d5125e5453a7 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:29.158423 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bbe876bd-6cf9-40c3-bb54-d5125e5453a7 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1094 microversion: 2.1 time: 0.067351 Aug 24 11:20:29.158955 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 502/1037] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:29 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:30.180968 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:30.182415 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:30.185902 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.191934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:30.192681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:30.193431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:30.194433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:30.194880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:30.195344 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:30.200028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:30.260394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:30.269936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-78e08fd1-6fde-4a88-b81d-96473276d844 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1210 microversion: 2.1 time: 0.092649 Aug 24 11:20:30.270511 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 536/1038] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:30 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:31.290885 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:31.292161 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:31.299371 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:31.299858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:31.300280 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:31.300968 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:31.301418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:31.301822 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:31.424585 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-81c788c3-c844-4789-9329-e9a14c47f3f0 req-f89504ce-6afd-413c-a2d1-06b6ab9601d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c44e80-6d1d-4417-a666-c66dc0247ccb", "tag": "1f3cd733-a37c-4efe-9536-b85b83fe3c86"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:31.434965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-81c788c3-c844-4789-9329-e9a14c47f3f0 req-f89504ce-6afd-413c-a2d1-06b6ab9601d6 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:31.435666 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-81c788c3-c844-4789-9329-e9a14c47f3f0 req-f89504ce-6afd-413c-a2d1-06b6ab9601d6 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:31.436274 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-81c788c3-c844-4789-9329-e9a14c47f3f0 req-f89504ce-6afd-413c-a2d1-06b6ab9601d6 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:31.442418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:31.450530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-53e4bc92-0593-4fce-aa53-8510fe88625c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.163499 Aug 24 11:20:31.451139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 503/1039] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:31 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:31.460233 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-81c788c3-c844-4789-9329-e9a14c47f3f0 req-f89504ce-6afd-413c-a2d1-06b6ab9601d6 service nova] Creating event network-changed:1f3cd733-a37c-4efe-9536-b85b83fe3c86 for instance a4c44e80-6d1d-4417-a666-c66dc0247ccb on hv-cinder-85427 Aug 24 11:20:31.466372 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-81c788c3-c844-4789-9329-e9a14c47f3f0 req-f89504ce-6afd-413c-a2d1-06b6ab9601d6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045568 Aug 24 11:20:31.466976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 537/1040] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:32.472901 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:32.473462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:32.480367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:32.480844 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:32.481294 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:32.481974 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:32.482417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:32.482835 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:32.620757 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:32.628865 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-aac584d8-45ec-46f5-bc5e-adf293ba317d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.159938 Aug 24 11:20:32.629450 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 504/1041] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:32 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:33.653643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:33.654323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:33.663988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:33.664594 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:33.665162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:33.666159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:33.666772 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:33.667342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:33.801480 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:33.809881 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9afce5bf-bf92-4123-9d5e-7051c145c8b5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.164233 Aug 24 11:20:33.810407 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 538/1042] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:33 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:34.834291 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:34.835221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:34.845179 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:34.845655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:34.846074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:34.846751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:34.847229 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:34.847639 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:34.995925 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:35.004166 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-da8ced4e-5b32-44eb-a378-0034b5da9f8c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.176698 Aug 24 11:20:35.004730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 505/1043] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:34 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:36.028864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:36.029685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:36.039872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:36.040580 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:36.041116 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:36.042109 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:36.042705 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:36.043327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:36.181481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:36.189822 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4028bdb4-ad12-456a-bd7b-3abed54b6fb1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.167540 Aug 24 11:20:36.190348 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 539/1044] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:36 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:37.219981 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:37.220600 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:37.227213 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:37.227691 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:37.228115 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:37.228793 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:37.229238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:37.229650 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:37.373619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:37.382129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-357d711e-3c28-43c7-aab0-09724217efd1 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.167795 Aug 24 11:20:37.382729 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 506/1045] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:37 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:38.406406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:38.407010 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:38.413896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:38.414376 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:38.414804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:38.415514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:38.415965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:38.416379 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:38.551907 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:38.560099 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-acb96590-74b1-4a1e-ab8d-2913bb937c83 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.158074 Aug 24 11:20:38.560675 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 540/1046] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:38 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:39.585381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:39.586308 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:39.589936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:39.598967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:39.599826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:39.600627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:39.601760 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:39.602510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:39.603989 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:39.607883 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:39.748417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:39.760640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2419d890-f9bc-49f1-a9b8-5c00b70076c9 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.181785 Aug 24 11:20:39.761730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 507/1047] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:39 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:40.783171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:40.783802 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:40.785978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:40.786841 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:20:40.793683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:40.794572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:40.794572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:40.795309 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:40.795756 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:40.796231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:40.934981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:40.943231 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9f0034b0-6e0b-44a0-ab30-a7b5d1193d34 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.164724 Aug 24 11:20:40.943760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 541/1048] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:40 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:41.968915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:41.969923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:41.981134 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:41.981924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:41.982640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:41.983886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:41.984332 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:41.984935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:42.134711 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:42.142875 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-6229899a-b994-41ed-a22e-5bbb2faa4c12 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.180950 Aug 24 11:20:42.143474 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 508/1049] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:41 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:42.375339 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-8c094cfc-1e1c-405e-a964-41760845cef7 req-3b313b1d-01ef-40e2-bec6-25ebe4df2f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c44e80-6d1d-4417-a666-c66dc0247ccb", "name": "network-vif-plugged", "status": "completed", "tag": "1f3cd733-a37c-4efe-9536-b85b83fe3c86"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:42.386277 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8c094cfc-1e1c-405e-a964-41760845cef7 req-3b313b1d-01ef-40e2-bec6-25ebe4df2f8e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:42.386839 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8c094cfc-1e1c-405e-a964-41760845cef7 req-3b313b1d-01ef-40e2-bec6-25ebe4df2f8e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:42.387374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-8c094cfc-1e1c-405e-a964-41760845cef7 req-3b313b1d-01ef-40e2-bec6-25ebe4df2f8e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:42.399618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-8c094cfc-1e1c-405e-a964-41760845cef7 req-3b313b1d-01ef-40e2-bec6-25ebe4df2f8e service nova] Creating event network-vif-plugged:1f3cd733-a37c-4efe-9536-b85b83fe3c86 for instance a4c44e80-6d1d-4417-a666-c66dc0247ccb on hv-cinder-85427 Aug 24 11:20:42.404788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-8c094cfc-1e1c-405e-a964-41760845cef7 req-3b313b1d-01ef-40e2-bec6-25ebe4df2f8e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033559 Aug 24 11:20:42.405380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 542/1050] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:20:43.173344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:43.174446 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:43.184723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:43.185523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:43.186246 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:43.187900 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:43.188358 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:43.188782 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:43.333508 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:43.341398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4f08090b-e8aa-4870-8ffd-b6e13db6ac57 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1265 microversion: 2.1 time: 0.175531 Aug 24 11:20:43.341948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 509/1051] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:43 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:44.364188 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:44.364855 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:44.371450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:44.371919 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:44.372333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:44.373007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:44.373444 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:44.373852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:44.519300 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:44.531908 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b1fc1b2b-f037-4852-9eb8-d848e282c46e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1452 microversion: 2.1 time: 0.172654 Aug 24 11:20:44.532478 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 543/1052] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:44 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:44.552473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:20:44.553078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:20:44.560078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:44.560563 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:44.560990 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:44.561924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:44.562807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:44.563264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:44.717748 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:20:44.725746 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-87fa49d4-9fca-4a78-a657-ebaf34b921e5 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1452 microversion: 2.1 time: 0.177132 Aug 24 11:20:44.726307 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 510/1053] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:20:44 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:20:46.365991 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-a5e102b2-908f-4af7-9e4b-af8134cf502a req-06591f10-7888-430c-8d2c-d7867a1150ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c44e80-6d1d-4417-a666-c66dc0247ccb", "tag": "1f3cd733-a37c-4efe-9536-b85b83fe3c86"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:20:46.376449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a5e102b2-908f-4af7-9e4b-af8134cf502a req-06591f10-7888-430c-8d2c-d7867a1150ce service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:20:46.376917 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a5e102b2-908f-4af7-9e4b-af8134cf502a req-06591f10-7888-430c-8d2c-d7867a1150ce service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:20:46.377340 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-a5e102b2-908f-4af7-9e4b-af8134cf502a req-06591f10-7888-430c-8d2c-d7867a1150ce service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:20:46.388643 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-a5e102b2-908f-4af7-9e4b-af8134cf502a req-06591f10-7888-430c-8d2c-d7867a1150ce service nova] Creating event network-changed:1f3cd733-a37c-4efe-9536-b85b83fe3c86 for instance a4c44e80-6d1d-4417-a666-c66dc0247ccb on hv-cinder-85427 Aug 24 11:20:46.394757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-a5e102b2-908f-4af7-9e4b-af8134cf502a req-06591f10-7888-430c-8d2c-d7867a1150ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031847 Aug 24 11:20:46.394953 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 544/1054] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:53.090923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=19 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:53.091695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=23 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:53.096024 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:53.096501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:53.103097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.103592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.104017 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.104687 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.105123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.105530 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.129011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-074f0b7f-d6cb-4a26-b175-0a8ba7284e89 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222/ips" status: 200 len: 149 microversion: 2.1 time: 0.040931 Aug 24 11:21:53.129562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 511/1055] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:21:53 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:53.139391 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=17 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:53.140306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=41 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:21:53.145264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "905e0267-79eb-40d3-b3f8-0032a6bda7b3"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:21:53.148047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:53.155677 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.156155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.156656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.157341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.157792 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.158263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.361382 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Invalid volume: volume 905e0267-79eb-40d3-b3f8-0032a6bda7b3 is already attached to instances: f26c942d-aa42-4377-9637-c5c426bd3a9e Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: POST /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222/os-volume_attachments HTTP/1.1 Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 74 Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:21:53.363164 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {"volumeAttachment": {"volumeId": "905e0267-79eb-40d3-b3f8-0032a6bda7b3"}} Aug 24 11:21:53.365038 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Invalid volume: volume 905e0267-79eb-40d3-b3f8-0032a6bda7b3 is already attached to instances: f26c942d-aa42-4377-9637-c5c426bd3a9e Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'server_id': 'bb7fe433-804a-4110-bb00-5c02bd4f0222', 'body': {'volumeAttachment': {'volumeId': '905e0267-79eb-40d3-b3f8-0032a6bda7b3'}}} Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 905e0267-79eb-40d3-b3f8-0032a6bda7b3 is already attached to instances: f26c942d-aa42-4377-9637-c5c426bd3a9e Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:53.366130 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 905e0267-79eb-40d3-b3f8-0032a6bda7b3 is already attached to instances: f26c942d-aa42-4377-9637-c5c426bd3a9e Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:53.367754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 905e0267-79eb-40d3-b3f8-0032a6bda7b3 is already attached to instances: f26c942d-aa42-4377-9637-c5c426bd3a9e Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 400 to user: Invalid volume: volume 905e0267-79eb-40d3-b3f8-0032a6bda7b3 is already attached to instances: f26c942d-aa42-4377-9637-c5c426bd3a9e {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4c73e7a5-d9db-4fda-8631-4819af32ace8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.227342 Aug 24 11:21:53.369527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 545/1056] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:21:53 2022] POST /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222/os-volume_attachments => generated 174 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:21:53.374879 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:53.375392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:53.381785 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.382268 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.382697 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.383403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.383861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.384300 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.412132 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:21:53.494684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0bdbbc92-a194-4ae8-8110-5eee630921db tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 204 len: 0 microversion: 2.1 time: 0.124575 Aug 24 11:21:53.495418 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 512/1057] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:21:53 2022] DELETE /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:21:53.504739 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:53.505341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:53.512128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.512602 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.513023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.513696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:53.514794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:53.514987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:53.671273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:53.679481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2d8afaee-db8c-4f4b-9d1f-09fce1d7163d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1682 microversion: 2.1 time: 0.178661 Aug 24 11:21:53.680040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 546/1058] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:53 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:54.703596 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:54.704269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:54.712369 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:54.712923 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:54.713462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:54.714255 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:54.714778 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:54.715297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:54.913215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:54.921432 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ce9f4647-a8f0-46cd-ae45-bdc3bba6395c tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1682 microversion: 2.1 time: 0.223053 Aug 24 11:21:54.922008 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 513/1059] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:54 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:55.942555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:55.943171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:55.950047 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:55.950518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:55.950946 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:55.951917 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:55.952433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:55.952965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:56.025227 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:56.040856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-798f88d5-416c-404b-9944-b01f973d356f tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 200 len: 1614 microversion: 2.1 time: 0.101853 Aug 24 11:21:56.041987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 547/1060] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:55 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:21:56.088090 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-7f7c1f3e-d072-4f6c-bed9-4d3d62a58f91 req-bdb9983e-c7f8-4c89-b2c1-a11642dbd32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7fe433-804a-4110-bb00-5c02bd4f0222", "name": "network-vif-deleted", "tag": "62451b87-1a55-4dc5-8531-0103b880dc90"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:21:56.098655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-7f7c1f3e-d072-4f6c-bed9-4d3d62a58f91 req-bdb9983e-c7f8-4c89-b2c1-a11642dbd32e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:56.099239 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-7f7c1f3e-d072-4f6c-bed9-4d3d62a58f91 req-bdb9983e-c7f8-4c89-b2c1-a11642dbd32e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:56.099668 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-7f7c1f3e-d072-4f6c-bed9-4d3d62a58f91 req-bdb9983e-c7f8-4c89-b2c1-a11642dbd32e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:56.111527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-7f7c1f3e-d072-4f6c-bed9-4d3d62a58f91 req-bdb9983e-c7f8-4c89-b2c1-a11642dbd32e service nova] Creating event network-vif-deleted:62451b87-1a55-4dc5-8531-0103b880dc90 for instance bb7fe433-804a-4110-bb00-5c02bd4f0222 on hv-cinder-85427 Aug 24 11:21:56.116778 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-7f7c1f3e-d072-4f6c-bed9-4d3d62a58f91 req-bdb9983e-c7f8-4c89-b2c1-a11642dbd32e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032343 Aug 24 11:21:56.117667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 514/1061] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:57.062266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:57.063593 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:57.070326 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:57.071088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:57.071527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:57.072217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:57.072656 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:57.073070 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:57.088101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 HTTP/1.1 Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:21:57.089646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:21:57.091129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'bb7fe433-804a-4110-bb00-5c02bd4f0222'} Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:21:57.091947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:21:57.093628 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:21:57.094944 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:21:57.094944 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-0cb88279-6efb-4986-b3a7-e91f933a1171 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 404 len: 111 microversion: 2.1 time: 0.032908 Aug 24 11:21:57.094944 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 548/1062] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:57 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:21:57.101367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e606b69d-47e2-4b39-8e98-b64637befcd7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '.version_select at 0x7f82b6342940>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:57.120751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e606b69d-47e2-4b39-8e98-b64637befcd7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020492736" status: 202 len: 0 microversion: 2.1 time: 0.024004 Aug 24 11:21:57.121461 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 515/1063] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 24 11:21:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020492736 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:21:57.875873 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:57.876359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:57.882364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:57.882859 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:57.883314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:57.884021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:57.884464 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:57.884881 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:57.972517 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lazy-loading 'services' on Instance uuid f26c942d-aa42-4377-9637-c5c426bd3a9e {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:21:58.047252 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b15d7b4d-7d99-4564-8ba1-91bde195b20a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments/905e0267-79eb-40d3-b3f8-0032a6bda7b3" status: 202 len: 0 microversion: 2.1 time: 0.175117 Aug 24 11:21:58.048093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 549/1064] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:21:57 2022] DELETE /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments/905e0267-79eb-40d3-b3f8-0032a6bda7b3 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:21:58.056558 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:58.058817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:58.066329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:58.066798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:58.067511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:58.068197 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:58.068622 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:58.069214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:58.102004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-63a9c83b-9324-4b36-beef-cf5f6ce455d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049399 Aug 24 11:21:58.102609 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 516/1065] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:58 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:21:59.115167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:59.117571 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:59.124663 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:59.125139 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:59.125567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:59.126271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:59.126941 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:59.127394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:59.158947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1bba3402-e017-4647-a563-2527f322cee8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048086 Aug 24 11:21:59.159445 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 550/1066] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:21:59 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:21:59.223598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:59.224228 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:59.231062 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:59.231556 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:59.231979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:59.232659 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:59.233347 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:59.233810 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:59.259484 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Going to try to terminate instance {{(pid=120788) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:21:59.344882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-15307b53-0d6e-46c7-aa8a-23d1295deea7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 204 len: 0 microversion: 2.1 time: 0.124977 Aug 24 11:21:59.345468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 517/1067] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:21:59 2022] DELETE /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:21:59.353874 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:21:59.354475 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:21:59.362740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:59.363276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:59.363709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:59.364402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:21:59.364850 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:21:59.365263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:21:59.505799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:21:59.514161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-576548e4-8507-4b08-9dc5-1aa223b2697b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1681 microversion: 2.1 time: 0.164038 Aug 24 11:21:59.514753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 551/1068] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:21:59 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:22:00.541715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:00.542832 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:00.553528 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:00.554329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:00.555040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:00.556208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:00.556947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:00.557637 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:00.697188 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:00.705324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-307bc812-ab33-4ba7-8411-a2031524d968 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1681 microversion: 2.1 time: 0.170794 Aug 24 11:22:00.705895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 518/1069] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:00 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:01.729958 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:01.730634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:01.737514 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:01.738004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:01.738430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:01.739145 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:01.739589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:01.740006 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:01.803955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:01.812641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6283ba10-52d7-4e35-a9d2-2099aaaa27fb tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 200 len: 1614 microversion: 2.1 time: 0.086353 Aug 24 11:22:01.813224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 552/1070] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:01 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:02.255170 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-a1bd71f1-ec13-425d-b0ba-544e3fe1c1ca req-ad003605-6e6d-4c65-8db9-295bb4683a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26c942d-aa42-4377-9637-c5c426bd3a9e", "name": "network-vif-deleted", "tag": "80fd0a36-77ea-41ee-8a00-c32913bbcdc7"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:02.266230 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a1bd71f1-ec13-425d-b0ba-544e3fe1c1ca req-ad003605-6e6d-4c65-8db9-295bb4683a1f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:02.266886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a1bd71f1-ec13-425d-b0ba-544e3fe1c1ca req-ad003605-6e6d-4c65-8db9-295bb4683a1f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:02.267395 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-a1bd71f1-ec13-425d-b0ba-544e3fe1c1ca req-ad003605-6e6d-4c65-8db9-295bb4683a1f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:02.280264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-a1bd71f1-ec13-425d-b0ba-544e3fe1c1ca req-ad003605-6e6d-4c65-8db9-295bb4683a1f service nova] Creating event network-vif-deleted:80fd0a36-77ea-41ee-8a00-c32913bbcdc7 for instance f26c942d-aa42-4377-9637-c5c426bd3a9e on hv-cinder-85427 Aug 24 11:22:02.285771 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-a1bd71f1-ec13-425d-b0ba-544e3fe1c1ca req-ad003605-6e6d-4c65-8db9-295bb4683a1f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034176 Aug 24 11:22:02.286295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 519/1071] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:02.834186 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:02.834894 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:02.841276 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:02.841748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:02.842184 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:02.842864 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:02.843328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:02.843925 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:02.857489 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e HTTP/1.1 Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:22:02.859293 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:22:02.861005 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'f26c942d-aa42-4377-9637-c5c426bd3a9e'} Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:22:02.861934 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:22:02.863634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:22:02.865097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:22:02.865097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-144f221a-4c43-4716-98ae-1292cefb9c42 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 404 len: 111 microversion: 2.1 time: 0.030644 Aug 24 11:22:02.865097 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 553/1072] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:02 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:22:02.870399 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-13608db7-ef11-4b53-b4a2-d649b86e4a01 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '.version_select at 0x7f82b6578700>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:02.892195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-13608db7-ef11-4b53-b4a2-d649b86e4a01 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016231801" status: 202 len: 0 microversion: 2.1 time: 0.025742 Aug 24 11:22:02.893078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 520/1073] 10.222.0.79 () {58 vars in 1221 bytes} [Wed Aug 24 11:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016231801 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:22:03.562268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-00f26e8c-0adc-4aa9-b6ff-9e429fb28d71 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: .version_select at 0x7f82b614d3a0>, body: {"keypair": {"name": "tempest-keypair-99910028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4/hd1FsvNMlsQ+TddE0yNbElg+PgGfitkPqgnwa4NwqGFEL19hCJR4yz7IwKOKg4hYdgQouWgszZTbZgTj0JwXo7z7hXlGK6JVAbdbFXoppGyw/c3HcLK8otK2IMA44Q=="}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:03.579579 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-00f26e8c-0adc-4aa9-b6ff-9e429fb28d71 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:22:03.583734 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-00f26e8c-0adc-4aa9-b6ff-9e429fb28d71 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:22:03.610831 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-00f26e8c-0adc-4aa9-b6ff-9e429fb28d71 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.054316 Aug 24 11:22:03.611443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 554/1074] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:22:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:05.156839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1432764609", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eded3bd1-408f-4f99-aa7f-088156d1dc13"}], "security_groups": [{"name": "tempest-securitygroup--799673039"}], "key_name": "tempest-keypair-99910028", "user_data": "}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:05.264895 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] validate_networks() for [('eded3bd1-408f-4f99-aa7f-088156d1dc13', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:22:05.688253 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:22:05.688670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:22:05.689128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:22:05.689527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:22:05.689930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:22:05.698858 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:05.699368 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:05.699798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:05.700543 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:05.700992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:05.702086 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:05.718967 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:22:05.723315 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:22:05.735553 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:22:05.737965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:22:05.791585 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3dc533d4-42b6-4e88-b6b1-f1df0444e289 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.639604 Aug 24 11:22:05.792232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 521/1075] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:22:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:22:05.803499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-aececb91-be47-474a-84bd-a0766aa59f81 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:05.804262 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-aececb91-be47-474a-84bd-a0766aa59f81 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:05.865247 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-aececb91-be47-474a-84bd-a0766aa59f81 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:05.872992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-aececb91-be47-474a-84bd-a0766aa59f81 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1240 microversion: 2.1 time: 0.073386 Aug 24 11:22:05.873660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 555/1076] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:05 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:06.893667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:06.894265 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:06.902310 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:06.903027 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:06.903695 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:06.904574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:06.905285 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:06.905883 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:06.969221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:06.976794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-df1a3691-9441-4c70-9c69-e8f818596854 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1298 microversion: 2.1 time: 0.087264 Aug 24 11:22:06.977383 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 522/1077] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:06 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:07.997405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:07.997939 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:08.004987 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:08.005544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:08.006039 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:08.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:08.007481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:08.007966 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:08.137971 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-4beb12b8-8bc0-44e2-8970-e401856fe866 req-bf211019-8f7c-41ec-9eaa-00b3507dca1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9116a39d-98f2-463e-842d-0a81c3d3de0a", "tag": "eba3acf9-caf7-4ee1-93cb-728b823ffc14"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:08.148891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4beb12b8-8bc0-44e2-8970-e401856fe866 req-bf211019-8f7c-41ec-9eaa-00b3507dca1c service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:08.149500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4beb12b8-8bc0-44e2-8970-e401856fe866 req-bf211019-8f7c-41ec-9eaa-00b3507dca1c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:08.150078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-4beb12b8-8bc0-44e2-8970-e401856fe866 req-bf211019-8f7c-41ec-9eaa-00b3507dca1c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:08.153622 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:08.161999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-4beb12b8-8bc0-44e2-8970-e401856fe866 req-bf211019-8f7c-41ec-9eaa-00b3507dca1c service nova] Creating event network-changed:eba3acf9-caf7-4ee1-93cb-728b823ffc14 for instance 9116a39d-98f2-463e-842d-0a81c3d3de0a on hv-cinder-85427 Aug 24 11:22:08.162737 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b077bcc1-d17e-4a39-9fc1-e11b885fc263 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.169368 Aug 24 11:22:08.163527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 556/1078] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:07 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:08.170191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-4beb12b8-8bc0-44e2-8970-e401856fe866 req-bf211019-8f7c-41ec-9eaa-00b3507dca1c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036258 Aug 24 11:22:08.171337 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 523/1079] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:22:09.184681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:09.185257 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:09.192419 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:09.192894 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:09.193311 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:09.193995 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:09.194439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:09.194846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:09.356122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:09.366358 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f51f1c5a-8111-41cf-9f23-edcf8ab804e3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.185860 Aug 24 11:22:09.367749 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 557/1080] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:09 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:10.390052 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:10.390929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:10.397916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:10.398384 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:10.398806 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:10.399500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:10.399936 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:10.400346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:10.556609 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:10.568769 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0a83930f-c380-4929-9ecc-80ed16d75697 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.183234 Aug 24 11:22:10.569570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 524/1081] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:10 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:11.595715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:11.596481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:11.604970 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:11.605555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:11.606062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:11.606964 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:11.607507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:11.608028 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:11.753148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:11.760925 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1a0c120a-f86c-460b-b157-2060fc17ad92 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.171009 Aug 24 11:22:11.761482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 558/1082] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:11 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:12.782506 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:12.783218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:12.790020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:12.790520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:12.790939 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:12.791655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:12.792101 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:12.792520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:12.939520 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:12.947782 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-bd64ba50-71a2-4a3b-bda4-a3d51ec8b8fe tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.169826 Aug 24 11:22:12.948400 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 525/1083] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:12 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:13.970753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:13.971420 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:13.978529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:13.979002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:13.979481 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:13.980190 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:13.980627 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:13.981036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:14.121451 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:14.133392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-28fc982c-ad3f-44f3-9f7e-5861c0eae1a3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.166951 Aug 24 11:22:14.134131 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 559/1084] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:13 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:14.854163 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-d32ef242-925e-457f-bd28-e86b92671662 req-097c6235-47b7-4b28-a6fb-75b980ec3cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9116a39d-98f2-463e-842d-0a81c3d3de0a", "name": "network-vif-plugged", "status": "completed", "tag": "eba3acf9-caf7-4ee1-93cb-728b823ffc14"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:14.864525 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d32ef242-925e-457f-bd28-e86b92671662 req-097c6235-47b7-4b28-a6fb-75b980ec3cf1 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:14.864992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d32ef242-925e-457f-bd28-e86b92671662 req-097c6235-47b7-4b28-a6fb-75b980ec3cf1 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:14.865424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-d32ef242-925e-457f-bd28-e86b92671662 req-097c6235-47b7-4b28-a6fb-75b980ec3cf1 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:14.877251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-d32ef242-925e-457f-bd28-e86b92671662 req-097c6235-47b7-4b28-a6fb-75b980ec3cf1 service nova] Creating event network-vif-plugged:eba3acf9-caf7-4ee1-93cb-728b823ffc14 for instance 9116a39d-98f2-463e-842d-0a81c3d3de0a on hv-cinder-85427 Aug 24 11:22:14.882306 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-d32ef242-925e-457f-bd28-e86b92671662 req-097c6235-47b7-4b28-a6fb-75b980ec3cf1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Aug 24 11:22:14.882945 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 526/1085] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:15.155926 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:15.156483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:15.163015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:15.163538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:15.163962 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:15.164639 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:15.165064 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:15.165480 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:15.308732 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:15.320171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-24bbcc68-a9f2-442c-9a53-51fa9132d817 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.168130 Aug 24 11:22:15.321007 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 560/1086] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:15 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:16.346930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:16.347730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:16.352497 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:16.353202 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:16.360203 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:16.360670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:16.361090 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:16.361751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:16.362188 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:16.362599 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:16.504682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:16.513126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c5bf1711-a0cd-4071-b0b1-c661db3199ee tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1365 microversion: 2.1 time: 0.167199 Aug 24 11:22:16.513679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 527/1087] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:16 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:17.537495 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:17.538090 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:17.540800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:17.548823 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:17.549507 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:17.550065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:17.551091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:17.551755 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:17.552342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:17.704071 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:17.712166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cc5fa0b9-00b5-438a-a31b-f30c9e3be9a1 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1554 microversion: 2.1 time: 0.181320 Aug 24 11:22:17.712736 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 561/1088] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:17 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:17.732453 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:17.733065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:17.739490 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:17.739955 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:17.740373 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:17.741040 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:17.741478 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:17.741884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:17.826862 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3a6a511e-0f29-43b4-a7db-a830dd27a15b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097775 Aug 24 11:22:17.827480 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 528/1089] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:22:17 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:18.806169 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-e63c8647-52d3-4af3-b165-86c00166600b req-8b0e98bf-2e1c-4233-af05-62106035b1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9116a39d-98f2-463e-842d-0a81c3d3de0a", "tag": "eba3acf9-caf7-4ee1-93cb-728b823ffc14"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:18.816591 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-e63c8647-52d3-4af3-b165-86c00166600b req-8b0e98bf-2e1c-4233-af05-62106035b1a2 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:18.817058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-e63c8647-52d3-4af3-b165-86c00166600b req-8b0e98bf-2e1c-4233-af05-62106035b1a2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:18.817482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-e63c8647-52d3-4af3-b165-86c00166600b req-8b0e98bf-2e1c-4233-af05-62106035b1a2 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:18.829124 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-e63c8647-52d3-4af3-b165-86c00166600b req-8b0e98bf-2e1c-4233-af05-62106035b1a2 service nova] Creating event network-changed:eba3acf9-caf7-4ee1-93cb-728b823ffc14 for instance 9116a39d-98f2-463e-842d-0a81c3d3de0a on hv-cinder-85427 Aug 24 11:22:18.834339 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-e63c8647-52d3-4af3-b165-86c00166600b req-8b0e98bf-2e1c-4233-af05-62106035b1a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031907 Aug 24 11:22:18.834942 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 562/1090] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:58.985105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:58.985853 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:58.989871 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-832191112", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2091664764", "security_groups": [{"name": "tempest-secgroup-smoke-533430042"}], "block_device_mapping_v2": [{"uuid": "22df95d9-3850-4bbb-b29d-6b7539d633f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "843628f4-43b9-4b8d-9051-b767617bbe5b"}]}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:22:59.123740 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.network.neutron [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] validate_networks() for [('843628f4-43b9-4b8d-9051-b767617bbe5b', None, None, None, None, None)] {{(pid=120788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:22:59.564387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Flavor limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:22:59.564805 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Image limits 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:22:59.565274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Flavor pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:22:59.565680 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Image pref 0:0:0 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:22:59.566043 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.virt.hardware [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:22:59.575508 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:59.575986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:59.576387 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:59.577103 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:59.577588 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:59.578004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:59.595386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:22:59.600153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Getting quotas for user c671384bbcc7405b85856efbc8dde5de and project 46fb2a59ebfe4b8eb4395b2281885b6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:22:59.664830 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Going to run 1 instances... {{(pid=120788) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:22:59.668301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22df95d9-3850-4bbb-b29d-6b7539d633f3',volume_size=None,volume_type=None)] {{(pid=120788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:22:59.811650 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fde7c174-64b2-428d-8171-f60082b5dd3d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828007 Aug 24 11:22:59.812295 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 529/1091] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:22:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:22:59.821413 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:59.822161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:59.826430 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-45fcab77-c5ac-497c-b441-ed8220208f39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:59.828681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-45fcab77-c5ac-497c-b441-ed8220208f39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:22:59.899373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-45fcab77-c5ac-497c-b441-ed8220208f39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:22:59.906723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-45fcab77-c5ac-497c-b441-ed8220208f39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1094 microversion: 2.1 time: 0.087068 Aug 24 11:22:59.907322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 563/1092] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:22:59 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:00.927723 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:00.929627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:00.937986 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:00.939292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:00.939736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:00.940442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:00.940892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:00.941305 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:01.011690 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:01.020260 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-63abdaab-9cb2-434b-bd9a-44f2edc1ce0e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1210 microversion: 2.1 time: 0.096869 Aug 24 11:23:01.021464 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 530/1093] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:00 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:02.043681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:02.044347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:02.052065 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:02.052704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:02.053181 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:02.054118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:02.054632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:02.055127 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:02.188871 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:02.196659 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6a331fcc-919a-483a-b2f8-a5a217d3d456 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.157171 Aug 24 11:23:02.197220 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 564/1094] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:02 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:02.501473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-c3691ea6-393e-4683-8153-0e3d108d9ce6 req-92ad86e4-b1e0-48ec-85b4-87011b6d7db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2", "tag": "1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:02.513773 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c3691ea6-393e-4683-8153-0e3d108d9ce6 req-92ad86e4-b1e0-48ec-85b4-87011b6d7db6 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:02.514324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c3691ea6-393e-4683-8153-0e3d108d9ce6 req-92ad86e4-b1e0-48ec-85b4-87011b6d7db6 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:02.514745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-c3691ea6-393e-4683-8153-0e3d108d9ce6 req-92ad86e4-b1e0-48ec-85b4-87011b6d7db6 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:02.526735 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-c3691ea6-393e-4683-8153-0e3d108d9ce6 req-92ad86e4-b1e0-48ec-85b4-87011b6d7db6 service nova] Creating event network-changed:1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78 for instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 on hv-cinder-85427 Aug 24 11:23:02.531947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-c3691ea6-393e-4683-8153-0e3d108d9ce6 req-92ad86e4-b1e0-48ec-85b4-87011b6d7db6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037226 Aug 24 11:23:02.532548 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 531/1095] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:03.222858 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:03.223810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:03.235895 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:03.236740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:03.237461 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:03.238606 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:03.239448 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:03.240155 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:03.393868 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:03.406249 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b3c9c7fb-d1d3-4a92-bd5d-a646bee77b6e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.190748 Aug 24 11:23:03.406815 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 565/1096] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:03 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:04.427715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:04.428380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:04.437428 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:04.437924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:04.439232 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:04.439768 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:04.440192 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:04.440647 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:04.586471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:04.598335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-fb77adf5-d1fc-4688-b9e5-7b139685b23d tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.175065 Aug 24 11:23:04.599105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 532/1097] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:04 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:05.626213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:05.626834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:05.634396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:05.634931 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:05.635452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:05.636205 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:05.636717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:05.637167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:05.773150 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:05.782072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-12e57248-6082-4569-9716-160fac553e25 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.162070 Aug 24 11:23:05.782674 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 566/1098] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:05 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:06.811225 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:06.812147 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:06.822517 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:06.823314 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:06.823926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:06.825065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:06.825671 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:06.826263 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:06.978700 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:06.987086 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ff4a2b98-095f-407f-80d7-8a2193307e4f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.182197 Aug 24 11:23:06.987650 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 533/1099] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:06 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:08.012187 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:08.013146 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:08.024337 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:08.025133 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:08.025856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:08.026982 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:08.027777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:08.028468 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:08.179286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:08.190026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8b72f017-5524-41cf-8e19-dd901d104a39 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.184111 Aug 24 11:23:08.190835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 567/1100] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:08 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:09.215097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:09.215737 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:09.223141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:09.223625 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:09.224068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:09.224745 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:09.225188 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:09.225580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:09.387965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:09.397926 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f27e308d-7bbc-4562-97a2-386d36cc5ede tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.186709 Aug 24 11:23:09.398648 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 534/1101] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:09 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:10.424807 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:10.425413 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:10.427822 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:10.433221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:10.433696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:10.434109 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:10.434793 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:10.435266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:10.435687 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:10.583738 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:10.595832 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-70f91ee9-d816-47e4-92d3-3933d9216515 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.176197 Aug 24 11:23:10.596577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 568/1102] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:10 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:11.616946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:11.617574 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:11.619562 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:11.620335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:11.626757 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:11.627262 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:11.627788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:11.628495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:11.628938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:11.629349 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:11.761744 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:11.769931 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-48457073-7c4c-47f2-b445-02f6c27e7ffb tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.156867 Aug 24 11:23:11.770482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 535/1103] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:11 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:12.795633 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:12.796318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:12.804376 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:12.804854 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:12.805278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:12.806032 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:12.806486 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:12.806891 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:12.941506 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:12.949345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-369c40f3-12e7-4e81-ba4d-528b492d3986 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.160479 Aug 24 11:23:12.949906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 569/1104] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:12 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:13.097534 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-afacb1e3-6fef-44bc-9f73-74a7ee53a42d req-95f0d64f-6121-4980-a695-e6edc16724a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2", "name": "network-vif-plugged", "status": "completed", "tag": "1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:13.107810 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-afacb1e3-6fef-44bc-9f73-74a7ee53a42d req-95f0d64f-6121-4980-a695-e6edc16724a7 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:13.108300 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-afacb1e3-6fef-44bc-9f73-74a7ee53a42d req-95f0d64f-6121-4980-a695-e6edc16724a7 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:13.108715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-afacb1e3-6fef-44bc-9f73-74a7ee53a42d req-95f0d64f-6121-4980-a695-e6edc16724a7 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:13.123378 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-afacb1e3-6fef-44bc-9f73-74a7ee53a42d req-95f0d64f-6121-4980-a695-e6edc16724a7 service nova] Creating event network-vif-plugged:1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78 for instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 on hv-cinder-85427 Aug 24 11:23:13.128867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-afacb1e3-6fef-44bc-9f73-74a7ee53a42d req-95f0d64f-6121-4980-a695-e6edc16724a7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035803 Aug 24 11:23:13.129750 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 536/1105] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:13.977821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:13.978759 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:13.989189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:13.989660 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:13.990079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:13.990762 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:13.991238 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:13.991649 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:14.126513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:14.135158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-dc62cd6f-f888-499d-bd7f-7a49c9fc2c95 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1265 microversion: 2.1 time: 0.165427 Aug 24 11:23:14.135730 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 570/1106] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:13 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:15.157678 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:15.158468 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:15.166000 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:15.166484 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:15.166906 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:15.167627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:15.168070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:15.168487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:15.316451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:15.326231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-77677a92-fc5a-4359-b6d1-f8dab367e364 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1453 microversion: 2.1 time: 0.173408 Aug 24 11:23:15.326799 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 537/1107] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:15 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:15.346974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:15.347637 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:15.354629 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:15.355147 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:15.355579 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:15.356259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:15.356699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:15.357111 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:15.503634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:15.517230 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-adfe70e1-053f-4032-b6ba-35a4b2af0696 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1453 microversion: 2.1 time: 0.173748 Aug 24 11:23:15.517883 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 571/1108] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:15 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:17.346756 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-335215ba-5527-432c-ad45-d9e55873ce40 req-a39d741f-354e-4e55-aafa-b3c299a9f5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2", "tag": "1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:17.356920 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-335215ba-5527-432c-ad45-d9e55873ce40 req-a39d741f-354e-4e55-aafa-b3c299a9f5a6 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:17.357325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-335215ba-5527-432c-ad45-d9e55873ce40 req-a39d741f-354e-4e55-aafa-b3c299a9f5a6 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:17.357751 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-335215ba-5527-432c-ad45-d9e55873ce40 req-a39d741f-354e-4e55-aafa-b3c299a9f5a6 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:17.368894 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-335215ba-5527-432c-ad45-d9e55873ce40 req-a39d741f-354e-4e55-aafa-b3c299a9f5a6 service nova] Creating event network-changed:1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78 for instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 on hv-cinder-85427 Aug 24 11:23:17.373719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-335215ba-5527-432c-ad45-d9e55873ce40 req-a39d741f-354e-4e55-aafa-b3c299a9f5a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090834 Aug 24 11:23:17.374637 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 538/1109] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:36.780835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:23:36.781400 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Wed Aug 24 11:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:23:41.088367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=20 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:41.089392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=48 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:41.153641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:41.154193 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:41.160653 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:41.161142 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:41.161580 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:41.162380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:41.163022 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:41.163548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:41.189725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-43b4e3c0-8832-47b9-80d6-e42a8a57d84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/ips" status: 200 len: 148 microversion: 2.1 time: 0.108736 Aug 24 11:23:41.190499 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 572/1110] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:23:41 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/ips => generated 148 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:42.531200 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:42.531953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=44 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:23:42.536163 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17740f2c-1cb8-4704-8775-8d50e4a2d3be"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:42.538776 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:42.545800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:42.546289 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:42.546705 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:42.547571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:42.548010 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:42.548411 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:42.804397 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4cdc41c6-8235-4914-b18b-259196df25bd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274694 Aug 24 11:23:42.805032 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 539/1111] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:23:42 2022] POST /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:50.402764 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17740f2c-1cb8-4704-8775-8d50e4a2d3be"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:50.405230 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:50.411933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:50.412419 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:50.412844 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:50.413574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:50.414052 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:50.414501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:50.495239 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Invalid volume: volume 17740f2c-1cb8-4704-8775-8d50e4a2d3be is already attached to instances: 9116a39d-98f2-463e-842d-0a81c3d3de0a Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: POST /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments HTTP/1.1 Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 74 Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:23:50.496972 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {"volumeAttachment": {"volumeId": "17740f2c-1cb8-4704-8775-8d50e4a2d3be"}} Aug 24 11:23:50.498632 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Invalid volume: volume 17740f2c-1cb8-4704-8775-8d50e4a2d3be is already attached to instances: 9116a39d-98f2-463e-842d-0a81c3d3de0a Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'server_id': '9116a39d-98f2-463e-842d-0a81c3d3de0a', 'body': {'volumeAttachment': {'volumeId': '17740f2c-1cb8-4704-8775-8d50e4a2d3be'}}} Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17740f2c-1cb8-4704-8775-8d50e4a2d3be is already attached to instances: 9116a39d-98f2-463e-842d-0a81c3d3de0a Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:23:50.499703 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17740f2c-1cb8-4704-8775-8d50e4a2d3be is already attached to instances: 9116a39d-98f2-463e-842d-0a81c3d3de0a Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:50.501288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17740f2c-1cb8-4704-8775-8d50e4a2d3be is already attached to instances: 9116a39d-98f2-463e-842d-0a81c3d3de0a Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 400 to user: Invalid volume: volume 17740f2c-1cb8-4704-8775-8d50e4a2d3be is already attached to instances: 9116a39d-98f2-463e-842d-0a81c3d3de0a {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e29f24e2-eafb-4df3-b403-eaffdf54f992 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099802 Aug 24 11:23:50.503000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 573/1112] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:23:50 2022] POST /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:23:50.575794 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:50.576348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:50.582578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:50.583081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:50.583535 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:50.584286 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:50.584661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:50.585113 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:50.677908 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lazy-loading 'services' on Instance uuid 9116a39d-98f2-463e-842d-0a81c3d3de0a {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:23:50.755158 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-40017747-7c2a-4145-b2aa-9d577b8fbb61 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments/17740f2c-1cb8-4704-8775-8d50e4a2d3be" status: 202 len: 0 microversion: 2.1 time: 0.184177 Aug 24 11:23:50.755777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 540/1113] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:23:50 2022] DELETE /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments/17740f2c-1cb8-4704-8775-8d50e4a2d3be => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:23:50.764415 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:50.766723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:50.773313 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:50.774080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:50.774517 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:50.775248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:50.775700 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:50.776141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:50.808368 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f0aa399f-4e67-455d-b858-bc2f9a0e2276 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047752 Aug 24 11:23:50.809090 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 574/1114] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:23:50 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:51.824326 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:51.827242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:51.834781 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:51.835296 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:51.836089 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:51.836806 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:51.837249 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:51.837660 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:51.870214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7f12a508-b3f2-41b3-9a51-2c82bf492401 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051790 Aug 24 11:23:51.870787 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 541/1115] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:23:51 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:23:51.947501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:51.948132 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:51.954492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:51.954976 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:51.955433 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:51.956267 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:51.956742 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:51.957160 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:51.983687 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:23:52.068072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-8e84aabe-b3fa-4af4-8369-8c2681b1d8b8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 204 len: 0 microversion: 2.1 time: 0.125960 Aug 24 11:23:52.069052 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 575/1116] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:23:51 2022] DELETE /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:23:52.077304 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:52.077874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:52.083970 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:52.084447 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:52.084877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:52.085880 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:52.086341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:52.086761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:52.248777 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:52.257292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c2c846a0-3fdb-40aa-90c8-fea0b0906c29 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1678 microversion: 2.1 time: 0.183918 Aug 24 11:23:52.257884 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 542/1117] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:52 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:53.291586 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:53.292347 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:53.300263 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:53.300814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:53.301285 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:53.302076 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:53.302589 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:53.303081 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:53.442988 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:53.453725 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-160dcbe0-65ab-45bd-a6d7-c75176122c3e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1678 microversion: 2.1 time: 0.168546 Aug 24 11:23:53.454295 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 576/1118] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:53 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:54.475587 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:54.476214 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:54.484598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:54.485088 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:54.485514 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:54.486211 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:54.486655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:54.487078 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:54.624655 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:54.632730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ab16df8f-f196-40a2-a2e1-b878fd0a1fff tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 200 len: 1678 microversion: 2.1 time: 0.161538 Aug 24 11:23:54.633319 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 543/1119] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:54 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:55.132322 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-d5f3014e-6875-461e-822e-2a06ab85bfa4 req-385ea1cc-2c0a-41b5-84b3-ec658dfee0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9116a39d-98f2-463e-842d-0a81c3d3de0a", "name": "network-vif-deleted", "tag": "eba3acf9-caf7-4ee1-93cb-728b823ffc14"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:55.144980 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-d5f3014e-6875-461e-822e-2a06ab85bfa4 req-385ea1cc-2c0a-41b5-84b3-ec658dfee0b9 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:55.146156 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-d5f3014e-6875-461e-822e-2a06ab85bfa4 req-385ea1cc-2c0a-41b5-84b3-ec658dfee0b9 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:55.146748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-d5f3014e-6875-461e-822e-2a06ab85bfa4 req-385ea1cc-2c0a-41b5-84b3-ec658dfee0b9 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:55.158927 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-d5f3014e-6875-461e-822e-2a06ab85bfa4 req-385ea1cc-2c0a-41b5-84b3-ec658dfee0b9 service nova] Creating event network-vif-deleted:eba3acf9-caf7-4ee1-93cb-728b823ffc14 for instance 9116a39d-98f2-463e-842d-0a81c3d3de0a on hv-cinder-85427 Aug 24 11:23:55.164913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-d5f3014e-6875-461e-822e-2a06ab85bfa4 req-385ea1cc-2c0a-41b5-84b3-ec658dfee0b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036409 Aug 24 11:23:55.165510 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 577/1120] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:55.653873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:55.654481 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:55.660953 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:55.661434 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:55.661859 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:55.662539 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:55.663008 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:55.663433 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:55.677391 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a HTTP/1.1 Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:23:55.679191 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:23:55.681114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '9116a39d-98f2-463e-842d-0a81c3d3de0a'} Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:23:55.682072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:23:55.684141 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:23:55.685619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:23:55.685619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-170a51a1-8e90-4866-987e-5beb16ee3ee7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 404 len: 111 microversion: 2.1 time: 0.030928 Aug 24 11:23:55.685619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 544/1121] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:55 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:23:55.691125 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-40ba900a-e0b2-4d27-8479-0eb0847e30ba tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '.version_select at 0x7f82b61efdc0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:55.711425 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-40ba900a-e0b2-4d27-8479-0eb0847e30ba tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99910028" status: 202 len: 0 microversion: 2.1 time: 0.024421 Aug 24 11:23:55.712123 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 578/1122] 10.222.0.79 () {58 vars in 1215 bytes} [Wed Aug 24 11:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99910028 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:23:56.376055 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4543c9c2-f89e-4dce-aa9d-0851976446a8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: .version_select at 0x7f82b638f160>, body: {"keypair": {"name": "tempest-keypair-830550463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5TWwbIq0uHWUsUbHKidVJ2Hthojuhu5m5SRlyrPVxY849SkvibWqRdBJWrbzzl2d9NnD0veVsWS/RnV7bV+Dy+QjDkRIOfseFdt11mG7tED5TEkzGpItuhey2HPM7k2g=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:56.391612 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-4543c9c2-f89e-4dce-aa9d-0851976446a8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:23:56.395357 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-4543c9c2-f89e-4dce-aa9d-0851976446a8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:23:56.418466 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4543c9c2-f89e-4dce-aa9d-0851976446a8 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046281 Aug 24 11:23:56.419038 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 545/1123] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:23:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:23:57.816879 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1120100410", "imageRef": "b2b5c465-d62e-47fe-be85-ab0a814bea6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eded3bd1-408f-4f99-aa7f-088156d1dc13"}], "security_groups": [{"name": "tempest-securitygroup--582402838"}], "key_name": "tempest-keypair-830550463", "user_data": "}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:23:57.927877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] validate_networks() for [('eded3bd1-408f-4f99-aa7f-088156d1dc13', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:23:58.318389 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:23:58.318799 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:23:58.319535 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:23:58.320518 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:23:58.320846 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:23:58.334157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:58.334768 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:58.335458 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:58.336306 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:58.336775 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:58.337189 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:58.354776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:23:58.358969 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Getting quotas for user 4ba76589063444ab8c8413114c64887e and project f81aba8df1554d12973333aff06d880a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:23:58.370776 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:23:58.373162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2b5c465-d62e-47fe-be85-ab0a814bea6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:23:58.436129 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c82b79c2-1358-4f05-8f89-a59e6857bbf2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.623605 Aug 24 11:23:58.436748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 579/1124] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:23:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:23:58.448692 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-a614f003-986b-4126-a387-0263fb205440 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:58.449360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-a614f003-986b-4126-a387-0263fb205440 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:58.505029 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-a614f003-986b-4126-a387-0263fb205440 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:58.512510 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-a614f003-986b-4126-a387-0263fb205440 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1241 microversion: 2.1 time: 0.068474 Aug 24 11:23:58.513152 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 546/1125] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:58 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:23:59.534396 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:23:59.534997 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:23:59.542149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:59.542626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:59.543062 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:59.543781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:23:59.544195 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:23:59.544599 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:23:59.614279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:23:59.622508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4e3db691-d99a-49b9-8859-67476f7a561d tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1299 microversion: 2.1 time: 0.092677 Aug 24 11:23:59.623105 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 580/1126] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:23:59 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:00.642512 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:00.643139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:00.650049 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:00.650534 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:00.650959 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:00.651670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:00.652111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:00.652525 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:00.784553 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:00.792888 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cc981f5e-436a-4688-b605-79cb43a7a443 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.154260 Aug 24 11:24:00.793487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 547/1127] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:00 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:00.852974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-9d7540fe-d192-46a9-9dc5-944829b45b57 req-2c8af02f-0e1e-425f-94bc-c4c298ddd03f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4a01f1-d0cb-43fa-bc4a-492cd5ae909e", "tag": "e39f0faa-1f60-47a0-90b5-b9d29b7b436c"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:00.865745 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9d7540fe-d192-46a9-9dc5-944829b45b57 req-2c8af02f-0e1e-425f-94bc-c4c298ddd03f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:00.866298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9d7540fe-d192-46a9-9dc5-944829b45b57 req-2c8af02f-0e1e-425f-94bc-c4c298ddd03f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:00.866803 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-9d7540fe-d192-46a9-9dc5-944829b45b57 req-2c8af02f-0e1e-425f-94bc-c4c298ddd03f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:00.879497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-9d7540fe-d192-46a9-9dc5-944829b45b57 req-2c8af02f-0e1e-425f-94bc-c4c298ddd03f service nova] Creating event network-changed:e39f0faa-1f60-47a0-90b5-b9d29b7b436c for instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e on hv-cinder-85427 Aug 24 11:24:00.885374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-9d7540fe-d192-46a9-9dc5-944829b45b57 req-2c8af02f-0e1e-425f-94bc-c4c298ddd03f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035970 Aug 24 11:24:00.886256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 581/1128] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:01.815813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:01.816534 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:01.825607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:01.826269 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:01.826896 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:01.827919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:01.828619 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:01.829229 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:01.978154 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:01.990991 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-332bac3d-2f9c-4fb2-95f2-abb2ebd222f7 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.179757 Aug 24 11:24:01.991947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 548/1129] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:01 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:03.014224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:03.015016 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:03.023074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:03.023546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:03.023965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:03.024661 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:03.025098 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:03.025503 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:03.165748 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:03.174141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-95f23189-94d0-44c3-9d8e-847df39c92dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.164239 Aug 24 11:24:03.174705 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 582/1130] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:03 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:04.197229 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:04.198033 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:04.206957 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:04.207692 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:04.208327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:04.209341 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:04.210002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:04.210627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:04.344292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:04.352242 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-14eda0c4-7b20-492f-8ce6-e7bf6f56f828 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.160631 Aug 24 11:24:04.352788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 549/1131] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:04 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:05.373418 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:05.373994 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:05.380728 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:05.381201 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:05.381639 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:05.382328 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:05.382922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:05.383380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:05.516319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:05.524885 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-40c6ee8e-aa3b-4af7-99e2-c8009f58e920 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.155368 Aug 24 11:24:05.525431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 583/1132] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:05 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:06.548579 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:06.549581 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:06.558025 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:06.558501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:06.558919 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:06.559631 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:06.560045 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:06.560486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:06.696031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:06.704741 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eb09591a-3b1d-4d3a-a04a-d16f2d294f03 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.162039 Aug 24 11:24:06.705317 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 550/1133] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:06 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:07.466828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-481e0bb6-d97f-4275-bd38-5bb5100ca95b req-8fda731d-b663-4f07-beae-7a8bdcbcecd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4a01f1-d0cb-43fa-bc4a-492cd5ae909e", "name": "network-vif-plugged", "status": "completed", "tag": "e39f0faa-1f60-47a0-90b5-b9d29b7b436c"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:07.476431 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-481e0bb6-d97f-4275-bd38-5bb5100ca95b req-8fda731d-b663-4f07-beae-7a8bdcbcecd8 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:07.476897 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-481e0bb6-d97f-4275-bd38-5bb5100ca95b req-8fda731d-b663-4f07-beae-7a8bdcbcecd8 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:07.477314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-481e0bb6-d97f-4275-bd38-5bb5100ca95b req-8fda731d-b663-4f07-beae-7a8bdcbcecd8 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:07.488380 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-481e0bb6-d97f-4275-bd38-5bb5100ca95b req-8fda731d-b663-4f07-beae-7a8bdcbcecd8 service nova] Creating event network-vif-plugged:e39f0faa-1f60-47a0-90b5-b9d29b7b436c for instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e on hv-cinder-85427 Aug 24 11:24:07.493370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-481e0bb6-d97f-4275-bd38-5bb5100ca95b req-8fda731d-b663-4f07-beae-7a8bdcbcecd8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087928 Aug 24 11:24:07.493912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 584/1134] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:07.726386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:07.727442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:07.734047 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:07.734540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:07.734992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:07.735734 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:07.736181 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:07.736594 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:07.867580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:07.875345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3a2e4ec4-eb2b-4161-a867-01166ffd2198 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.153087 Aug 24 11:24:07.875909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 551/1135] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:07 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:08.894314 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:08.895074 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:08.900668 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:08.901352 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:08.908303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:08.908771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:08.909190 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:08.909852 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:08.910286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:08.910712 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:09.058364 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:09.067469 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-fee8d258-05fd-4404-bbad-b41da4921893 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1366 microversion: 2.1 time: 0.173996 Aug 24 11:24:09.068061 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 585/1136] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:08 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:10.092540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:10.093275 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:10.095826 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:10.102708 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:10.103218 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:10.103843 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:10.104529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:10.104978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:10.105417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:10.267692 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:10.276610 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4eb75948-3ed9-4988-b5fa-be9b8d4e5771 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1555 microversion: 2.1 time: 0.190061 Aug 24 11:24:10.277180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 552/1137] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:10 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:10.299040 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:10.299651 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:10.308027 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:10.308502 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:10.308928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:10.309613 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:10.310057 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:10.310473 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:10.390462 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7fb6391a-9407-404c-978d-fcbb11adb1d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097425 Aug 24 11:24:10.391093 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 586/1138] 10.222.0.79 () {58 vars in 1275 bytes} [Wed Aug 24 11:24:10 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:11.599083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-84b78a20-9ea1-40eb-9f58-12bc2d8f66ed req-123e5a73-ada5-45e6-9c6c-926b6e4d1ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de4a01f1-d0cb-43fa-bc4a-492cd5ae909e", "tag": "e39f0faa-1f60-47a0-90b5-b9d29b7b436c"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:11.610072 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-84b78a20-9ea1-40eb-9f58-12bc2d8f66ed req-123e5a73-ada5-45e6-9c6c-926b6e4d1ffc service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:11.610621 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-84b78a20-9ea1-40eb-9f58-12bc2d8f66ed req-123e5a73-ada5-45e6-9c6c-926b6e4d1ffc service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:11.611146 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-84b78a20-9ea1-40eb-9f58-12bc2d8f66ed req-123e5a73-ada5-45e6-9c6c-926b6e4d1ffc service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:11.622807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-84b78a20-9ea1-40eb-9f58-12bc2d8f66ed req-123e5a73-ada5-45e6-9c6c-926b6e4d1ffc service nova] Creating event network-changed:e39f0faa-1f60-47a0-90b5-b9d29b7b436c for instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e on hv-cinder-85427 Aug 24 11:24:11.627891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-84b78a20-9ea1-40eb-9f58-12bc2d8f66ed req-123e5a73-ada5-45e6-9c6c-926b6e4d1ffc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032613 Aug 24 11:24:11.628467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 553/1139] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:12.863326 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:25:12.864471 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:25:17.184863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:17.189054 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:17.190207 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:17.192127 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:17.203830 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.204658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:17.205860 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-fe12a528-646e-4ce9-a4d4-2e2d1e98d861 req-e7000c02-1558-47ae-a0a4-b8da54e88910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2", "tag": "1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:17.213526 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.214088 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.214572 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.215416 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.215936 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.216411 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.216786 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fe12a528-646e-4ce9-a4d4-2e2d1e98d861 req-e7000c02-1558-47ae-a0a4-b8da54e88910 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.217259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fe12a528-646e-4ce9-a4d4-2e2d1e98d861 req-e7000c02-1558-47ae-a0a4-b8da54e88910 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.217752 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-fe12a528-646e-4ce9-a4d4-2e2d1e98d861 req-e7000c02-1558-47ae-a0a4-b8da54e88910 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.232580 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-fe12a528-646e-4ce9-a4d4-2e2d1e98d861 req-e7000c02-1558-47ae-a0a4-b8da54e88910 service nova] Creating event network-changed:1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78 for instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 on hv-cinder-85427 Aug 24 11:25:17.238162 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-fe12a528-646e-4ce9-a4d4-2e2d1e98d861 req-e7000c02-1558-47ae-a0a4-b8da54e88910 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051050 Aug 24 11:25:17.239223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 554/1140] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:17.246496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:25:17.340904 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-67624dc4-1225-4430-9420-fe6b148295a0 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "DELETE /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 204 len: 0 microversion: 2.1 time: 0.158127 Aug 24 11:25:17.342370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 587/1141] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:17 2022] DELETE /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:25:17.351194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.352277 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:17.360627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.361373 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.361806 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.362489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.363139 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.363561 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.503628 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:17.511789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-4de3a535-f954-40a7-b697-156b0c43940f tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1578 microversion: 2.1 time: 0.164933 Aug 24 11:25:17.512363 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 555/1142] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:17 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:18.533286 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:18.534021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:18.541318 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:18.541779 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:18.542152 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:18.542821 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:18.543373 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:18.543787 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:18.680327 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:18.691550 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4356c17f-7811-4e2a-8567-e492328c5d84 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1578 microversion: 2.1 time: 0.162396 Aug 24 11:25:18.692342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 588/1143] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:18 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:19.584385 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-ca963e90-25c1-427e-96a3-8919ce1d0fd6 req-61a1077a-f6c4-4f0d-a094-81af718a596c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2", "name": "network-vif-deleted", "tag": "1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:19.597517 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-ca963e90-25c1-427e-96a3-8919ce1d0fd6 req-61a1077a-f6c4-4f0d-a094-81af718a596c service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.597994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-ca963e90-25c1-427e-96a3-8919ce1d0fd6 req-61a1077a-f6c4-4f0d-a094-81af718a596c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.598486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-ca963e90-25c1-427e-96a3-8919ce1d0fd6 req-61a1077a-f6c4-4f0d-a094-81af718a596c service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.611928 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-ca963e90-25c1-427e-96a3-8919ce1d0fd6 req-61a1077a-f6c4-4f0d-a094-81af718a596c service nova] Creating event network-vif-deleted:1e1cf5c8-dbe8-4ea7-88bd-3fbd3cfb1a78 for instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 on hv-cinder-85427 Aug 24 11:25:19.617862 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-ca963e90-25c1-427e-96a3-8919ce1d0fd6 req-61a1077a-f6c4-4f0d-a094-81af718a596c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037455 Aug 24 11:25:19.618458 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 556/1144] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:19.714056 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:19.714651 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:19.721333 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.721811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.722230 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.722914 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.723390 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.723801 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.792158 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:19.801424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ee5fa951-f951-43b5-933b-54b503f1544c tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 200 len: 1225 microversion: 2.1 time: 0.091359 Aug 24 11:25:19.801990 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 589/1145] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:19 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:20.827710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:20.828977 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:20.838536 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.839013 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.839475 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.840154 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.840599 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.841011 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.854866 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] HTTP exception thrown: Instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 could not be found. Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Request method failure captured: Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 HTTP/1.1 Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBginuYasCxz_wgDBkGW2KjBN_pJxdcDPJonHLJGmBou2xe_29MgcTpaA7EZ-8w8ETeJCcen7hRkQaZLKwEbRqRvhMZF5qzqVZAqLv4XcE4nO1HZCrGpHLZ0bir5-MZEg87jOiKBpBfvZ99KNb9kjhpe06ySK35rWUst9lZ9FlrXEPqw Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:20.856523 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46fb2a59ebfe4b8eb4395b2281885b6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: c671384bbcc7405b85856efbc8dde5de Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 could not be found. Aug 24 11:25:20.858297 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2'} Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 could not be found. Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:20.859251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 could not be found. Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 could not be found. Aug 24 11:25:20.860779 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:20.862183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Returning 404 to user: Instance 44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:20.862183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0ee2e3dc-4ed6-46e5-9713-3b86779794ec tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2" status: 404 len: 111 microversion: 2.1 time: 0.037768 Aug 24 11:25:20.862183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 557/1146] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:20 2022] GET /compute/v2.1/servers/44f8a3cb-5d49-4cdb-a5a5-f3884f192fa2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:24.028375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:24.029573 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:24.030327 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-15dd291e-9123-4f4c-bb3f-23d6dd513246 req-35b9bacb-df62-49d9-8463-40f6e27f70b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c44e80-6d1d-4417-a666-c66dc0247ccb", "tag": "1f3cd733-a37c-4efe-9536-b85b83fe3c86"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:24.036476 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.037019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.037504 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.038256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.038760 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.039345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.040611 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-15dd291e-9123-4f4c-bb3f-23d6dd513246 req-35b9bacb-df62-49d9-8463-40f6e27f70b3 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.041095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-15dd291e-9123-4f4c-bb3f-23d6dd513246 req-35b9bacb-df62-49d9-8463-40f6e27f70b3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.041517 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-15dd291e-9123-4f4c-bb3f-23d6dd513246 req-35b9bacb-df62-49d9-8463-40f6e27f70b3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.053004 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-15dd291e-9123-4f4c-bb3f-23d6dd513246 req-35b9bacb-df62-49d9-8463-40f6e27f70b3 service nova] Creating event network-changed:1f3cd733-a37c-4efe-9536-b85b83fe3c86 for instance a4c44e80-6d1d-4417-a666-c66dc0247ccb on hv-cinder-85427 Aug 24 11:25:24.058364 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-15dd291e-9123-4f4c-bb3f-23d6dd513246 req-35b9bacb-df62-49d9-8463-40f6e27f70b3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031673 Aug 24 11:25:24.059496 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 558/1147] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:24.066413 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:25:24.151870 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-7aca377e-420b-40c8-838d-bc4e60bc35ae tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 204 len: 0 microversion: 2.1 time: 0.126969 Aug 24 11:25:24.152955 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 590/1148] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:24 2022] DELETE /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:25:24.161891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:24.162542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:24.172213 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.172887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.173334 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.174036 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.174672 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.175114 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.314227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:24.322495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-69498fdb-db8a-4587-adbe-28cfd52485bf tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1577 microversion: 2.1 time: 0.164848 Aug 24 11:25:24.323095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 559/1149] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:24 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:24.332120 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:24.333634 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:24.340208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.340720 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.341148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.341835 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.342279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.342664 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.366857 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2f94f852-cdde-47e1-9d21-49a3a6fdd0d5 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/ips" status: 200 len: 149 microversion: 2.1 time: 0.039044 Aug 24 11:25:24.367922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 591/1150] 10.222.0.79 () {58 vars in 1248 bytes} [Wed Aug 24 11:25:24 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:25.343728 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:25.344359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:25.350775 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.351278 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.351708 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.352380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.352814 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.353231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.486807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:25.495380 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-35441339-d0af-4488-9451-ed3e4dff5b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1577 microversion: 2.1 time: 0.155530 Aug 24 11:25:25.495969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 560/1151] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:25 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:25.706706 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abb79065-85f6-4a2f-b430-48564354b77e"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:25.709110 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:25.716681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.717183 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.717612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.718298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.718744 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.719190 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.003618 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-36bc39b1-919f-4c68-8182-057f953d5102 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "POST /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300837 Aug 24 11:25:26.004228 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 592/1152] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:25:25 2022] POST /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:26.337106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-6ba5a31c-57f8-4804-8da2-02f2b99893c7 req-543e3242-bd84-4024-a0d3-5833143d3923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c44e80-6d1d-4417-a666-c66dc0247ccb", "name": "network-vif-deleted", "tag": "1f3cd733-a37c-4efe-9536-b85b83fe3c86"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:26.346441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6ba5a31c-57f8-4804-8da2-02f2b99893c7 req-543e3242-bd84-4024-a0d3-5833143d3923 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.347135 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6ba5a31c-57f8-4804-8da2-02f2b99893c7 req-543e3242-bd84-4024-a0d3-5833143d3923 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.347367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-6ba5a31c-57f8-4804-8da2-02f2b99893c7 req-543e3242-bd84-4024-a0d3-5833143d3923 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.360194 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-6ba5a31c-57f8-4804-8da2-02f2b99893c7 req-543e3242-bd84-4024-a0d3-5833143d3923 service nova] Creating event network-vif-deleted:1f3cd733-a37c-4efe-9536-b85b83fe3c86 for instance a4c44e80-6d1d-4417-a666-c66dc0247ccb on hv-cinder-85427 Aug 24 11:25:26.365096 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-6ba5a31c-57f8-4804-8da2-02f2b99893c7 req-543e3242-bd84-4024-a0d3-5833143d3923 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031847 Aug 24 11:25:26.365908 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 561/1153] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:26.520244 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:26.520962 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:26.528086 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.528563 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.528986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.529692 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.530118 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.530529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.598296 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c671384bbcc7405b85856efbc8dde5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fb2a59ebfe4b8eb4395b2281885b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:26.607251 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f063900b-9368-4b52-8988-42ce94027138 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 200 len: 1225 microversion: 2.1 time: 0.091997 Aug 24 11:25:26.608147 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 593/1154] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:26 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:27.634920 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:27.636136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: a4c44e80-6d1d-4417-a666-c66dc0247ccb] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:27.643994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:27.644780 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:27.645473 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:27.646153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:27.646592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:27.646997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:27.664987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] HTTP exception thrown: Instance a4c44e80-6d1d-4417-a666-c66dc0247ccb could not be found. Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Request method failure captured: Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb HTTP/1.1 Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBginuYasCxz_wgDBkGW2KjBN_pJxdcDPJonHLJGmBou2xe_29MgcTpaA7EZ-8w8ETeJCcen7hRkQaZLKwEbRqRvhMZF5qzqVZAqLv4XcE4nO1HZCrGpHLZ0bir5-MZEg87jOiKBpBfvZ99KNb9kjhpe06ySK35rWUst9lZ9FlrXEPqw Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:27.666586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46fb2a59ebfe4b8eb4395b2281885b6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: c671384bbcc7405b85856efbc8dde5de Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance a4c44e80-6d1d-4417-a666-c66dc0247ccb could not be found. Aug 24 11:25:27.668454 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'a4c44e80-6d1d-4417-a666-c66dc0247ccb'} Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c44e80-6d1d-4417-a666-c66dc0247ccb could not be found. Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:27.669500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c44e80-6d1d-4417-a666-c66dc0247ccb could not be found. Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c44e80-6d1d-4417-a666-c66dc0247ccb could not be found. Aug 24 11:25:27.671169 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:27.672774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Returning 404 to user: Instance a4c44e80-6d1d-4417-a666-c66dc0247ccb could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:27.672774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-9ea79c4d-5b82-4d3f-adc5-63fe0cb39199 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb" status: 404 len: 111 microversion: 2.1 time: 0.040929 Aug 24 11:25:27.672774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 562/1155] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:27 2022] GET /compute/v2.1/servers/a4c44e80-6d1d-4417-a666-c66dc0247ccb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:28.127922 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:28.128450 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:28.135962 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.136332 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.136758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.137434 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.137883 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.138331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.154993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] HTTP exception thrown: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Request method failure captured: Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: DELETE /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 HTTP/1.1 Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBginuYasCxz_wgDBkGW2KjBN_pJxdcDPJonHLJGmBou2xe_29MgcTpaA7EZ-8w8ETeJCcen7hRkQaZLKwEbRqRvhMZF5qzqVZAqLv4XcE4nO1HZCrGpHLZ0bir5-MZEg87jOiKBpBfvZ99KNb9kjhpe06ySK35rWUst9lZ9FlrXEPqw Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:25:28.156740 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46fb2a59ebfe4b8eb4395b2281885b6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: c671384bbcc7405b85856efbc8dde5de Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.158203 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '69e7a1e2-de96-447d-b786-d19bd604b744'} Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:28.159259 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.160973 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.162496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Returning 404 to user: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:28.162496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-37211e10-9b03-43fc-bd2a-853a4d57f788 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "DELETE /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 404 len: 111 microversion: 2.1 time: 0.034138 Aug 24 11:25:28.162496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 594/1156] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:28 2022] DELETE /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:25:28.167090 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:28.167947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] [instance: 69e7a1e2-de96-447d-b786-d19bd604b744] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:28.173979 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.174462 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.174891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.175675 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.176120 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.176534 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.190947 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] HTTP exception thrown: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Request method failure captured: Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 HTTP/1.1 Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBginuYasCxz_wgDBkGW2KjBN_pJxdcDPJonHLJGmBou2xe_29MgcTpaA7EZ-8w8ETeJCcen7hRkQaZLKwEbRqRvhMZF5qzqVZAqLv4XcE4nO1HZCrGpHLZ0bir5-MZEg87jOiKBpBfvZ99KNb9kjhpe06ySK35rWUst9lZ9FlrXEPqw Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:28.192482 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46fb2a59ebfe4b8eb4395b2281885b6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46fb2a59ebfe4b8eb4395b2281885b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: 46fb2a59ebfe4b8eb4395b2281885b6e Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1896558210 Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: c671384bbcc7405b85856efbc8dde5de Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestVolumeBootPattern-1896558210-project Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.194095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '69e7a1e2-de96-447d-b786-d19bd604b744'} Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:28.195185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. Aug 24 11:25:28.196763 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:28.198359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Returning 404 to user: Instance 69e7a1e2-de96-447d-b786-d19bd604b744 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:28.198359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-d2e2adb7-e1a2-4374-9b5b-560a7db67f2e tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744" status: 404 len: 111 microversion: 2.1 time: 0.030855 Aug 24 11:25:28.198359 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 563/1157] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:28 2022] GET /compute/v2.1/servers/69e7a1e2-de96-447d-b786-d19bd604b744 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:29.531961 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-551be380-0ce6-4ee3-82b0-73f0f3b47b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] Calling method '.version_select at 0x7f82b614d1f0>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:29.554767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-551be380-0ce6-4ee3-82b0-73f0f3b47b06 tempest-TestVolumeBootPattern-1896558210 tempest-TestVolumeBootPattern-1896558210-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2091664764" status: 202 len: 0 microversion: 2.1 time: 0.027312 Aug 24 11:25:29.555370 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 595/1158] 10.222.0.79 () {58 vars in 1263 bytes} [Wed Aug 24 11:25:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2091664764 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:25:32.656886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:32.657444 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:32.663761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.664231 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.664653 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.665367 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.665814 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.666224 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.750111 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.objects.instance [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lazy-loading 'services' on Instance uuid de4a01f1-d0cb-43fa-bc4a-492cd5ae909e {{(pid=120788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:25:32.848501 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eb02dd68-cdc5-4c76-a386-de9415ca6716 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments/abb79065-85f6-4a2f-b430-48564354b77e" status: 202 len: 0 microversion: 2.1 time: 0.195401 Aug 24 11:25:32.849092 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 564/1159] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:25:32 2022] DELETE /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments/abb79065-85f6-4a2f-b430-48564354b77e => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:25:32.857683 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:32.860305 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:32.868242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.868962 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.869624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.870559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.871280 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.871828 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.905929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-3a811779-8fc9-4013-8d93-c673e4e49dab tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052319 Aug 24 11:25:32.906650 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 596/1160] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:25:32 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:33.919417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:33.921776 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:33.928187 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:33.928677 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:33.929106 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:33.929798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:33.930244 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:33.930647 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:33.960710 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-ce41f10a-1af4-4cae-9454-cf0104a48477 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046400 Aug 24 11:25:33.961251 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 565/1161] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:25:33 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:25:34.022588 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:34.023114 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:34.029735 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.030208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.030729 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.031508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.031948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.032355 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.062644 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:25:34.150426 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-e0b50488-9b3f-42c2-9626-c4879325a02e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 204 len: 0 microversion: 2.1 time: 0.129068 Aug 24 11:25:34.151912 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 597/1162] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:34 2022] DELETE /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:25:34.162715 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:34.163667 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:34.173007 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.173495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.173927 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.174625 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.175099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.175521 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.337573 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:34.345516 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2eed266a-a8ca-492c-bc48-9fe1b9056718 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1680 microversion: 2.1 time: 0.188386 Aug 24 11:25:34.346079 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 566/1163] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:34 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:35.367769 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:35.369106 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:35.375867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.376345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.376771 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:35.377460 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.377906 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.378320 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:35.590810 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:35.598527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-26f700cb-35a9-48de-9d59-f8e945899b8e tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1680 microversion: 2.1 time: 0.235161 Aug 24 11:25:35.599124 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 598/1164] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:35 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:36.621457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:36.621457 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:36.630623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:36.630623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:36.630623 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.634995 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:36.635571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:36.636060 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.714517 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba76589063444ab8c8413114c64887e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81aba8df1554d12973333aff06d880a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:36.722916 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-af2a8e12-63b5-43be-b5b7-fd02235a4533 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 200 len: 1613 microversion: 2.1 time: 0.106077 Aug 24 11:25:36.723693 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 567/1165] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:36 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 1613 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:36.969439 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-0c256a3e-0eb4-47c3-9b43-3eb1aecabb11 req-ddf3bf74-9875-4c38-807c-8b5ce07c0eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de4a01f1-d0cb-43fa-bc4a-492cd5ae909e", "name": "network-vif-deleted", "tag": "e39f0faa-1f60-47a0-90b5-b9d29b7b436c"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:36.982080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-0c256a3e-0eb4-47c3-9b43-3eb1aecabb11 req-ddf3bf74-9875-4c38-807c-8b5ce07c0eb8 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:36.982546 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-0c256a3e-0eb4-47c3-9b43-3eb1aecabb11 req-ddf3bf74-9875-4c38-807c-8b5ce07c0eb8 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:36.983270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-0c256a3e-0eb4-47c3-9b43-3eb1aecabb11 req-ddf3bf74-9875-4c38-807c-8b5ce07c0eb8 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.994574 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:36.996789 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-0c256a3e-0eb4-47c3-9b43-3eb1aecabb11 req-ddf3bf74-9875-4c38-807c-8b5ce07c0eb8 service nova] Creating event network-vif-deleted:e39f0faa-1f60-47a0-90b5-b9d29b7b436c for instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e on hv-cinder-85427 Aug 24 11:25:37.002080 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-0c256a3e-0eb4-47c3-9b43-3eb1aecabb11 req-ddf3bf74-9875-4c38-807c-8b5ce07c0eb8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036264 Aug 24 11:25:37.003361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 599/1166] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:37.746500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:37.748009 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:37.755703 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.756739 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.757461 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.758338 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.759065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.759496 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.774673 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e HTTP/1.1 Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:37.776381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:37.778041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'de4a01f1-d0cb-43fa-bc4a-492cd5ae909e'} Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:37.778997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:37.780864 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:37.782128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:37.782128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0b455e10-7537-45d3-854b-6d69c36ac78a tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 404 len: 111 microversion: 2.1 time: 0.035800 Aug 24 11:25:37.782128 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 568/1167] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:37 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:37.789135 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-eb93fd3d-d72c-4d28-9341-5851a9f072f2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '.version_select at 0x7f82b6136c10>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:37.826400 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-eb93fd3d-d72c-4d28-9341-5851a9f072f2 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830550463" status: 202 len: 0 microversion: 2.1 time: 0.042045 Aug 24 11:25:37.832072 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 600/1168] 10.222.0.79 () {58 vars in 1218 bytes} [Wed Aug 24 11:25:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830550463 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:25:39.630404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:39.630930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:39.638223 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.638709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.639173 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.639861 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.640320 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.640736 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.655466 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e HTTP/1.1 Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:39.657003 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.658730 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'de4a01f1-d0cb-43fa-bc4a-492cd5ae909e'} Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:39.659850 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.661467 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.663094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:39.663094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-abb69093-d80b-4275-b058-d58df2ac2c27 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 404 len: 111 microversion: 2.1 time: 0.031840 Aug 24 11:25:39.663094 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 569/1169] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:39 2022] DELETE /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:39.667872 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:39.668591 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: de4a01f1-d0cb-43fa-bc4a-492cd5ae909e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:39.675087 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.675599 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.676023 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.676707 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.677157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.677603 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.692052 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e HTTP/1.1 Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:25:39.693620 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.695558 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'de4a01f1-d0cb-43fa-bc4a-492cd5ae909e'} Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:39.696565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. Aug 24 11:25:39.698223 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:39.699665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance de4a01f1-d0cb-43fa-bc4a-492cd5ae909e could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:39.699665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-712860e0-cff1-450c-995d-97d03bff08dc tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e" status: 404 len: 111 microversion: 2.1 time: 0.031895 Aug 24 11:25:39.699665 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 601/1170] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:39 2022] GET /compute/v2.1/servers/de4a01f1-d0cb-43fa-bc4a-492cd5ae909e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:40.853298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:40.853811 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:40.860924 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.861404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.861816 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.862492 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.862930 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.863386 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.877104 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a HTTP/1.1 Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:40.878626 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.880404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '9116a39d-98f2-463e-842d-0a81c3d3de0a'} Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:40.882123 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.883912 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.885613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:40.885613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-cdcefa3b-a2bc-48bc-9da1-546939e89cd3 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 404 len: 111 microversion: 2.1 time: 0.030895 Aug 24 11:25:40.885613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 570/1171] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:40 2022] DELETE /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:40.890717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:40.891429 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: 9116a39d-98f2-463e-842d-0a81c3d3de0a] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:40.901241 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.901723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.902149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.902829 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.903303 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.903718 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.918288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a HTTP/1.1 Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:25:40.919992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.921693 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': '9116a39d-98f2-463e-842d-0a81c3d3de0a'} Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:40.922757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. Aug 24 11:25:40.924351 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.925865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance 9116a39d-98f2-463e-842d-0a81c3d3de0a could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:40.925865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-d9b3d3a8-e10e-4012-849c-01f9c39676b6 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a" status: 404 len: 111 microversion: 2.1 time: 0.036292 Aug 24 11:25:40.925865 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 602/1172] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:40 2022] GET /compute/v2.1/servers/9116a39d-98f2-463e-842d-0a81c3d3de0a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:40.931877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:40.932366 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:40.938719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.939233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.939664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.940344 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.940797 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.941217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.956048 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 HTTP/1.1 Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:40.957604 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:40.959325 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'bb7fe433-804a-4110-bb00-5c02bd4f0222'} Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:40.960227 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:40.961951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:40.963571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:40.963571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f1056256-6280-499c-87e1-8a963c7e07dd tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 404 len: 111 microversion: 2.1 time: 0.031694 Aug 24 11:25:40.963571 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 571/1173] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:40 2022] DELETE /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:25:40.970292 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:40.971273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: bb7fe433-804a-4110-bb00-5c02bd4f0222] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:40.981278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.981980 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.982624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.983733 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.984357 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.985000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:41.000978 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 HTTP/1.1 Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:25:41.002496 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:41.004281 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'bb7fe433-804a-4110-bb00-5c02bd4f0222'} Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:41.005141 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. Aug 24 11:25:41.006933 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:41.008268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance bb7fe433-804a-4110-bb00-5c02bd4f0222 could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:41.008268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-940df818-153f-463d-9b4b-18d18357e648 tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222" status: 404 len: 111 microversion: 2.1 time: 0.039591 Aug 24 11:25:41.008268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 603/1174] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:40 2022] GET /compute/v2.1/servers/bb7fe433-804a-4110-bb00-5c02bd4f0222 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:25:42.155264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:42.155809 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:42.162409 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.162891 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.163349 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.164036 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.164489 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.165560 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.179415 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e HTTP/1.1 Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:25:42.181597 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.183284 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': 'f26c942d-aa42-4377-9637-c5c426bd3a9e'} Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:42.184511 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.186221 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.188164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:42.188164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c6c522b1-42ed-4d51-8b00-9e7f6622d98b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 404 len: 111 microversion: 2.1 time: 0.031646 Aug 24 11:25:42.188164 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 572/1175] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:25:42 2022] DELETE /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:42.191492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:42.192091 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] [instance: f26c942d-aa42-4377-9637-c5c426bd3a9e] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:42.198567 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.199033 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.199505 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.200149 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.200583 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.201002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.216735 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.wsgi [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] HTTP exception thrown: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Request method failure captured: Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: request: GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e HTTP/1.1 Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept: application/json Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Accept-Encoding: identity Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Connection: close Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Length: 0 Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Content-Type: application/json Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Host: 10.222.0.79 Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Openstack-System-Scope: None Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Auth-Token: gAAAAABjBgj9-PYsGZIP0Fk8gNd0fXQI-Rj7S3KErfcCLUAQU1-aLDTHmvEfg9etUWTcOLXPaej1aeZxC9iB0AzvNqZe54axoVYJe4RF3aBE-eIIvITghzWSBiCf9f-gsKPycByywu4xxAiacFm178u1BNavAuFypJCrQYk905Fzhz7ePMZZHlM Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Id: None Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Domain-Name: None Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Identity-Status: Confirmed Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Is-Admin-Project: True Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Id: default Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Domain-Name: Default Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Project-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Role: reader,member Aug 24 11:25:42.218325 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Roles: reader,member Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f81aba8df1554d12973333aff06d880a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f81aba8df1554d12973333aff06d880a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f81aba8df1554d12973333aff06d880a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Id: f81aba8df1554d12973333aff06d880a Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-477853020 Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Id: default Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Domain-Name: Default Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Id: 4ba76589063444ab8c8413114c64887e Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: X-User-Name: tempest-AttachVolumeNegativeTest-477853020-project Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: method: > Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: exception: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.220019 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: action_args: {'id': 'f26c942d-aa42-4377-9637-c5c426bd3a9e'} Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:42.221435 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. Aug 24 11:25:42.222981 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR nova.api.openstack.wsgi Aug 24 11:25:42.224538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] Returning 404 to user: Instance f26c942d-aa42-4377-9637-c5c426bd3a9e could not be found. {{(pid=120789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:42.224538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1183068d-3c4e-420c-9e49-d2dd953bf84b tempest-AttachVolumeNegativeTest-477853020 tempest-AttachVolumeNegativeTest-477853020-project] 10.222.0.79 "GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e" status: 404 len: 111 microversion: 2.1 time: 0.032075 Aug 24 11:25:42.224538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 604/1176] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:42 2022] GET /compute/v2.1/servers/f26c942d-aa42-4377-9637-c5c426bd3a9e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:26:36.092020 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-b83e7c05-e1b8-4123-861f-6d1a36624e3d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Action: 'create', calling method: .version_select at 0x7f82b6396d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1795060525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM8BrLqrDaFzF9lNNL080Cf2EAOjfLWNB3w+Hy1mrroKaa7PaSqparTDC46xUuwCUCORXQ3bTYCv9YtEohc/uJJl+UT+D+no4nsqz1vLg0VYSQzmnjYJVKsgyPWaskyOg=="}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:36.097767 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=38 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:36.098417 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:36.112247 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-b83e7c05-e1b8-4123-861f-6d1a36624e3d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Getting quotas for project a49cb5a236194efd92736ce55834d95a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:36.116594 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.quota [None req-b83e7c05-e1b8-4123-861f-6d1a36624e3d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Getting quotas for user 70ed3be3841a42fba100ab939d3d11e6 and project a49cb5a236194efd92736ce55834d95a. Resources: {'key_pairs'} {{(pid=120788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:36.129282 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b83e7c05-e1b8-4123-861f-6d1a36624e3d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:26:37.136627 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [None req-b83e7c05-e1b8-4123-861f-6d1a36624e3d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [c86dd01d-adcf-424d-82b9-4c1eb77c9334] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 49162. Aug 24 11:26:37.157479 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-b83e7c05-e1b8-4123-861f-6d1a36624e3d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.069262 Aug 24 11:26:37.158083 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 573/1177] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Aug 24 11:26:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:37.215577 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-199306494", "imageRef": "f6e3465a-3c53-4040-8368-f249d35f8923", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1795060525", "networks": [{"uuid": "6515b718-6a47-44d0-9712-ac14681996b1"}]}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:37.224175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:37.224794 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=8 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:37.272068 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.network.neutron [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] validate_networks() for [('6515b718-6a47-44d0-9712-ac14681996b1', None, None, None, None, None)] {{(pid=120789) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:37.792837 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Flavor limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:37.793256 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Image limits 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:37.793711 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Flavor pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:37.794128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Image pref 0:0:0 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:37.794530 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.virt.hardware [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120789) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:37.805269 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.805743 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.806171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.806889 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.807394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.807814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.825497 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Getting quotas for project a49cb5a236194efd92736ce55834d95a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:37.829555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.quota [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Getting quotas for user 70ed3be3841a42fba100ab939d3d11e6 and project a49cb5a236194efd92736ce55834d95a. Resources: {'ram', 'instances', 'cores'} {{(pid=120789) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:37.841246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Going to run 1 instances... {{(pid=120789) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:37.843513 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6e3465a-3c53-4040-8368-f249d35f8923',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120789) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:37.897785 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [1466bb87-aabd-4d69-b82a-cccc4444503b] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:26:38.909170 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO oslo.messaging._drivers.impl_rabbit [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [1466bb87-aabd-4d69-b82a-cccc4444503b] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 49178. Aug 24 11:26:38.916543 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-6fa1650e-6971-48dc-bd60-d2fffbbe6d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705986 Aug 24 11:26:38.917192 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 605/1178] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:26:38.928342 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-75d1bf57-cbdc-41c3-b64c-12deaa82df8c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:38.928940 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-75d1bf57-cbdc-41c3-b64c-12deaa82df8c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:38.984185 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-75d1bf57-cbdc-41c3-b64c-12deaa82df8c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:38.991333 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-75d1bf57-cbdc-41c3-b64c-12deaa82df8c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1258 microversion: 2.1 time: 0.067237 Aug 24 11:26:38.991962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 574/1179] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:38 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:40.013793 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:40.014617 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:40.021877 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:40.022360 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:40.022781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:40.023800 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:40.024246 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:40.024658 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:40.093378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:40.102345 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-76bc7aa0-93ee-40df-9602-2b94f9266f54 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1328 microversion: 2.1 time: 0.092211 Aug 24 11:26:40.102929 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 606/1180] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:40 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:41.124997 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:41.125547 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:41.132992 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:41.133951 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:41.134684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:41.135592 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:41.136215 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:41.136803 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:41.294538 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:41.303542 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c8348b67-83ce-4791-ab94-63cc2479ced7 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.182426 Aug 24 11:26:41.304486 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 575/1181] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:41 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:42.326709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:42.327557 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:42.336704 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.337161 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.337597 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.338298 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:42.338897 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:42.339361 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:42.485767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:42.495061 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-1c23a5b1-e95d-45cf-9c4c-0047c4208130 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.172693 Aug 24 11:26:42.496101 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 607/1182] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:42 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:43.516294 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:43.516876 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:43.524183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.524765 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.525324 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.526134 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.526598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.527023 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.711217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:43.720774 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7a683214-b1ce-4f22-9fb4-20519c0291f4 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.208444 Aug 24 11:26:43.721613 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 576/1183] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:43 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:44.742202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:44.742924 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:44.752375 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.752928 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.753359 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.754052 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:44.754494 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:44.754905 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:44.892548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:44.901021 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-102b47af-1ded-455f-9aa6-cc18267cf68d tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.162974 Aug 24 11:26:44.901601 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 608/1184] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:44 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:45.921618 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:45.922274 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:45.929326 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.930358 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.930839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:45.931570 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:45.932025 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:45.932441 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:46.082427 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:46.091204 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-efb89992-d97d-487c-992f-5894c47e9ccb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.173563 Aug 24 11:26:46.091781 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 577/1185] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:45 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:47.114058 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:47.114723 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:47.122248 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:47.122750 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:47.123206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:47.123896 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:47.124341 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:47.124757 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:47.277527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:47.289414 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-ef6df7c5-9d8c-43f9-95b7-771dcd75ce61 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.179184 Aug 24 11:26:47.289974 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 609/1186] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:47 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:48.311213 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:48.311873 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:48.318620 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.319085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.319536 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.320208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:48.320672 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:48.321080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:48.461362 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:48.469303 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-3159a0af-20fe-4a56-b603-e455b7f34629 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.162381 Aug 24 11:26:48.469867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 578/1187] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:48 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:49.492148 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:49.493015 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:49.495367 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=2 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:49.496208 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell0:SELECT=6 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:49.506324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:49.507108 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:49.508449 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:49.509178 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:49.509624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:49.510037 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:49.656153 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:49.663979 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f01dedf4-1d8d-45e9-99be-ddccd6c53b68 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.177011 Aug 24 11:26:49.664560 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 610/1188] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:49 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:50.684798 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:50.685392 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:50.687389 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=6 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:50.692273 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.692762 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.693180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.693867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.694316 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.694733 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.832095 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:50.840129 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2989fc2d-9bb8-483f-922b-89ba5bfb258f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.159320 Aug 24 11:26:50.840702 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 579/1189] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:50 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:50.908194 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-da71497e-9ba2-4a36-8869-78fec7c31d88 req-77b72833-10ff-42a3-bf5a-02e5c364ac9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07833cd0-250b-4023-af2c-5b95f8548849", "tag": "52a096cf-f9f3-4765-98d7-99bc1da29b11"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:50.919545 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-da71497e-9ba2-4a36-8869-78fec7c31d88 req-77b72833-10ff-42a3-bf5a-02e5c364ac9d service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:50.920162 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-da71497e-9ba2-4a36-8869-78fec7c31d88 req-77b72833-10ff-42a3-bf5a-02e5c364ac9d service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:50.920676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-da71497e-9ba2-4a36-8869-78fec7c31d88 req-77b72833-10ff-42a3-bf5a-02e5c364ac9d service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:50.935397 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-da71497e-9ba2-4a36-8869-78fec7c31d88 req-77b72833-10ff-42a3-bf5a-02e5c364ac9d service nova] Creating event network-changed:52a096cf-f9f3-4765-98d7-99bc1da29b11 for instance 07833cd0-250b-4023-af2c-5b95f8548849 on hv-cinder-85427 Aug 24 11:26:50.940790 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-da71497e-9ba2-4a36-8869-78fec7c31d88 req-77b72833-10ff-42a3-bf5a-02e5c364ac9d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037455 Aug 24 11:26:50.941593 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 611/1190] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:26:51.866084 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:51.867644 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:51.878743 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:51.879709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:51.880532 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:51.881656 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:51.882416 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:51.883254 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:52.018403 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:52.026892 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-817bbce3-874f-47cc-9096-998a8a06e8b1 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.167521 Aug 24 11:26:52.027500 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 580/1191] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:51 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:53.054716 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:53.055508 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:53.061737 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:53.062226 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:53.062653 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:53.063362 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:53.063806 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:53.064217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:53.209388 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:53.220940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-4392510b-e10e-4378-ab6a-37bf7008a750 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.174029 Aug 24 11:26:53.221624 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 612/1192] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:53 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:54.244292 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:54.244904 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:54.251541 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.252012 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.252429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.253099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:54.253540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:54.253948 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:54.383213 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:54.391105 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-994e712f-f8e6-4a6e-9ad2-7fc94728fe33 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.151420 Aug 24 11:26:54.391658 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 581/1193] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:54 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:55.415580 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:55.416183 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:55.422834 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.423366 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.423774 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.424474 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:55.424919 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:55.425338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:55.719561 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:55.728268 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-046d447a-84c2-4e09-86ea-6c792c7a2107 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.317852 Aug 24 11:26:55.730814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 613/1194] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:55 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:56.280583 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-09f67313-5a6f-495a-988b-a69a120239a6 req-e9814310-507c-4374-973f-660b28db71e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07833cd0-250b-4023-af2c-5b95f8548849", "name": "network-vif-plugged", "status": "completed", "tag": "52a096cf-f9f3-4765-98d7-99bc1da29b11"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:56.291213 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-09f67313-5a6f-495a-988b-a69a120239a6 req-e9814310-507c-4374-973f-660b28db71e3 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.291699 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-09f67313-5a6f-495a-988b-a69a120239a6 req-e9814310-507c-4374-973f-660b28db71e3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.292183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-09f67313-5a6f-495a-988b-a69a120239a6 req-e9814310-507c-4374-973f-660b28db71e3 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.304965 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-09f67313-5a6f-495a-988b-a69a120239a6 req-e9814310-507c-4374-973f-660b28db71e3 service nova] Creating event network-vif-plugged:52a096cf-f9f3-4765-98d7-99bc1da29b11 for instance 07833cd0-250b-4023-af2c-5b95f8548849 on hv-cinder-85427 Aug 24 11:26:56.310439 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-09f67313-5a6f-495a-988b-a69a120239a6 req-e9814310-507c-4374-973f-660b28db71e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Aug 24 11:26:56.311016 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 582/1195] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:56.755402 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:56.756294 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:56.768288 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.769079 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.769805 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.770965 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:56.771754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:56.772446 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:56.922612 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:56.934517 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-a5f2d9ca-4fda-40c2-a39c-74df3ef60026 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1358 microversion: 2.1 time: 0.185467 Aug 24 11:26:56.935324 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 614/1196] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:56 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:57.959252 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:57.959988 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:57.966451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.966935 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.967393 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.968080 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.968527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.968946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.169666 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.177461 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-0ffa655c-17c2-404d-98ed-548e5696844e tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1548 microversion: 2.1 time: 0.222575 Aug 24 11:26:58.178261 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 583/1197] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:57 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:58.198946 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:58.199570 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:58.206157 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.206639 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.207083 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.207777 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.208221 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.208639 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.342568 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.350467 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2234369f-e6c8-40dc-9289-69ae3c3d921c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1548 microversion: 2.1 time: 0.156065 Aug 24 11:26:58.351036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 615/1198] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:58 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:58.370180 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:58.374807 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.375586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Searching by: {'deleted': False, 'project_id': 'a49cb5a236194efd92736ce55834d95a'} {{(pid=120788) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 11:26:58.382583 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.383065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.383529 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.384235 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.384680 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.385093 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.495081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.multi_cell_list [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120788) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 11:26:58.591800 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-beef663f-833e-4ee4-9efe-1580f1dbad17 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.225371 Aug 24 11:26:58.592398 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 584/1199] 10.222.0.79 () {58 vars in 1125 bytes} [Wed Aug 24 11:26:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:58.603886 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:58.604487 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:58.610536 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.611004 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.611466 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.612167 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.612605 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.613013 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.748523 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:58.756867 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-b23eb78a-852d-42d9-b96a-5b72df3b45fe tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1548 microversion: 2.1 time: 0.156969 Aug 24 11:26:58.757443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 616/1200] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:58 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:00.326085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64f6f821-f4b9-469c-90dc-7188e54ceddb"}} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:00.328459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:00.335476 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.336554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.336554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.337148 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:00.337661 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:00.338120 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:00.597483 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-75453560-0da8-4ef4-8812-9545ff5e0f77 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275212 Aug 24 11:27:00.598041 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 585/1201] 10.222.0.79 () {60 vars in 1323 bytes} [Wed Aug 24 11:27:00 2022] POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:08.271340 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:08.271993 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:08.275853 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:08.283241 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.283813 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.284378 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.285331 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:08.285986 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:08.286538 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.290470 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=65 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:08.437159 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:08.446094 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-f4eb63ac-bf83-45de-98d6-fe910722f373 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1594 microversion: 2.1 time: 0.180974 Aug 24 11:27:08.446699 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 617/1202] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:08 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1594 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:10.384126 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell0:SELECT=2 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:10.384909 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:10.389335 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-104f6ac6-bfcb-4c32-bd1f-6b9d079e1a97 req-12c9a873-8ae9-4a89-8a58-4fb792057165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07833cd0-250b-4023-af2c-5b95f8548849", "tag": "52a096cf-f9f3-4765-98d7-99bc1da29b11"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:10.401590 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-104f6ac6-bfcb-4c32-bd1f-6b9d079e1a97 req-12c9a873-8ae9-4a89-8a58-4fb792057165 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:10.401966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-104f6ac6-bfcb-4c32-bd1f-6b9d079e1a97 req-12c9a873-8ae9-4a89-8a58-4fb792057165 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:10.402385 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-104f6ac6-bfcb-4c32-bd1f-6b9d079e1a97 req-12c9a873-8ae9-4a89-8a58-4fb792057165 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:10.407188 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:10.416761 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-104f6ac6-bfcb-4c32-bd1f-6b9d079e1a97 req-12c9a873-8ae9-4a89-8a58-4fb792057165 service nova] Creating event network-changed:52a096cf-f9f3-4765-98d7-99bc1da29b11 for instance 07833cd0-250b-4023-af2c-5b95f8548849 on hv-cinder-85427 Aug 24 11:27:10.421874 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-104f6ac6-bfcb-4c32-bd1f-6b9d079e1a97 req-12c9a873-8ae9-4a89-8a58-4fb792057165 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039889 Aug 24 11:27:10.422726 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 586/1203] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:11.589913 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-348536732"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:11.590501 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:11.597278 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.597753 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.598175 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.598880 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.599417 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.599827 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.740687 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.network.security_group_api [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Adding security group f32f75a6-d85e-45c2-99dc-9cd5a331571a to port 52a096cf-f9f3-4765-98d7-99bc1da29b11 Aug 24 11:27:12.500856 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-9e222079-00f7-45fa-b76c-9f80144b8397 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/action" status: 202 len: 0 microversion: 2.1 time: 0.915432 Aug 24 11:27:12.501541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 618/1204] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:27:11 2022] POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:27:12.513362 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:12.514222 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:12.523250 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.524074 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.524809 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.526153 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.526976 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.527810 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.627709 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [req-f2299c28-003e-4c0c-935b-29b8cdab65a8 req-6f35ae14-5f68-4f6a-87be-c4e6a3c7d61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07833cd0-250b-4023-af2c-5b95f8548849", "tag": "52a096cf-f9f3-4765-98d7-99bc1da29b11"}]} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:12.638676 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f2299c28-003e-4c0c-935b-29b8cdab65a8 req-6f35ae14-5f68-4f6a-87be-c4e6a3c7d61f service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.639562 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f2299c28-003e-4c0c-935b-29b8cdab65a8 req-6f35ae14-5f68-4f6a-87be-c4e6a3c7d61f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.639985 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [req-f2299c28-003e-4c0c-935b-29b8cdab65a8 req-6f35ae14-5f68-4f6a-87be-c4e6a3c7d61f service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.659767 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.compute.server_external_events [req-f2299c28-003e-4c0c-935b-29b8cdab65a8 req-6f35ae14-5f68-4f6a-87be-c4e6a3c7d61f service nova] Creating event network-changed:52a096cf-f9f3-4765-98d7-99bc1da29b11 for instance 07833cd0-250b-4023-af2c-5b95f8548849 on hv-cinder-85427 Aug 24 11:27:12.665541 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [req-f2299c28-003e-4c0c-935b-29b8cdab65a8 req-6f35ae14-5f68-4f6a-87be-c4e6a3c7d61f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129930 Aug 24 11:27:12.666778 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 619/1205] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:12.727830 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:12.738272 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c66b2c49-34b2-4951-98eb-60b4b830812f tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1758 microversion: 2.1 time: 0.231477 Aug 24 11:27:12.738941 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 587/1206] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:12 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1758 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:13.239694 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=5 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:13.240662 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=11 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:13.246492 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:13.248802 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:13.256338 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.256814 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.257270 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.257948 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.258386 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.258804 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.339565 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-236fc10a-77c0-49f8-a303-2ecf32c36e2c tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/action" status: 202 len: 0 microversion: 2.1 time: 0.102554 Aug 24 11:28:13.343076 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 620/1207] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:28:13 2022] POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:28:13.346346 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=4 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:13.347521 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=7 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:13.351388 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:13.351994 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:13.358999 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.359494 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.359906 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.360578 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.360998 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.361424 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.508031 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:13.516978 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-7aa7ae20-3a09-42e5-803b-b2cc3cfd9d0b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1750 microversion: 2.1 time: 0.172388 Aug 24 11:28:13.517788 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 588/1208] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:13 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:14.543524 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:14.544617 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:14.554881 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.555712 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.556529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.557202 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.557644 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.558055 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.710705 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:14.722586 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-27eeee4d-cffa-48b8-a72d-10528491de1b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.187091 Aug 24 11:28:14.723374 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 621/1209] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:14 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:15.753472 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:15.754167 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:15.762345 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.762822 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.763287 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.763966 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.764404 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.764813 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.906281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:15.914831 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f6c829f4-e541-4780-ac5b-0e3b7a4a2845 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.166386 Aug 24 11:28:15.915450 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 589/1210] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:15 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:16.942967 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:16.944017 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:16.956392 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.957362 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.958076 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.959283 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.959992 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.960685 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.128773 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:17.139264 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-c22701c5-3fc0-4c9d-97b6-de5231b7ed4a tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.202813 Aug 24 11:28:17.139863 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 622/1211] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:16 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:18.166435 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:18.167521 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:18.179001 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.179842 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.180536 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.181680 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.182099 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.182524 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.345097 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:18.353495 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-eea3252f-1827-4318-9baf-023c68c4e259 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.194067 Aug 24 11:28:18.354059 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 590/1212] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:18 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:19.378876 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:19.380026 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:19.388527 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.389000 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.389424 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.390107 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.390548 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.391274 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.538833 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.547825 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-312fb063-f8be-4806-ba61-d7b1ed420a45 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.175416 Aug 24 11:28:19.548405 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 623/1213] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:19 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:20.573311 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.574259 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.584332 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.585217 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.585962 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.587117 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.587887 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.588301 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.747586 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.755877 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-e8fac37a-0018-4b7d-9c65-384354c3ada2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.189820 Aug 24 11:28:20.756442 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 591/1214] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:21.781330 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:21.782122 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:21.790862 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.791394 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.791809 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.792484 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.792919 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.793323 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.950811 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:21.963715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-5ae6016f-359a-46c4-832a-525bfecc7683 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.188614 Aug 24 11:28:21.964329 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 624/1215] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:21 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:22.989351 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:22.990070 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:22.998684 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.999159 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.999572 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.000240 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:23.000675 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:23.001081 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.158034 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:23.166665 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-c5fddab1-1847-43f3-81b0-0efeea1641c2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.183886 Aug 24 11:28:23.167264 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 592/1216] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:22 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:24.192910 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:24.193887 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:24.205360 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.206107 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.206788 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.207920 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.208626 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.209282 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.358199 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:24.370695 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-845a4fea-2705-48a0-b305-06b30b0d4030 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1755 microversion: 2.1 time: 0.184425 Aug 24 11:28:24.371319 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 625/1217] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:24 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:24.448342 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:28:24.448607 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Wed Aug 24 11:28:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:28:25.395886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:25.396630 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:25.407206 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:25.407817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:25.408487 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:25.409540 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:25.410243 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:25.410827 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:25.564354 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:25.573240 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-435983cd-4b66-46f6-8305-4b5dc43e31cb tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1758 microversion: 2.1 time: 0.183881 Aug 24 11:28:25.573817 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 593/1218] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:25 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:32.876852 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:28:32.878055 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:29:28.949581 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_api:SELECT=12 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:28.950779 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG dbcounter [-] [120789] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:28.957529 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-348536732"}} {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:28.958266 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:28.967985 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.968715 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.969315 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.970350 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.970947 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.971555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.120559 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.network.security_group_api [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Removing security group f32f75a6-d85e-45c2-99dc-9cd5a331571a from port 52a096cf-f9f3-4765-98d7-99bc1da29b11 Aug 24 11:29:29.446762 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-36170b20-cc8a-4390-bbf2-211009eaa3c8 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/action" status: 202 len: 0 microversion: 2.1 time: 0.502021 Aug 24 11:29:29.450454 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 626/1219] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:28 2022] POST /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:29.456329 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-28b56459-3944-464d-b67e-bc048b231449 req-367c7260-6961-4c2f-a59e-08c1a7e96803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07833cd0-250b-4023-af2c-5b95f8548849", "tag": "52a096cf-f9f3-4765-98d7-99bc1da29b11"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:29.461527 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_api:SELECT=12 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:29.462151 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG dbcounter [-] [120788] Writing DB stats nova_cell1:SELECT=36 {{(pid=120788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:29.468607 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-28b56459-3944-464d-b67e-bc048b231449 req-367c7260-6961-4c2f-a59e-08c1a7e96803 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.469063 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-28b56459-3944-464d-b67e-bc048b231449 req-367c7260-6961-4c2f-a59e-08c1a7e96803 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.469991 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-28b56459-3944-464d-b67e-bc048b231449 req-367c7260-6961-4c2f-a59e-08c1a7e96803 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.483886 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-28b56459-3944-464d-b67e-bc048b231449 req-367c7260-6961-4c2f-a59e-08c1a7e96803 service nova] Creating event network-changed:52a096cf-f9f3-4765-98d7-99bc1da29b11 for instance 07833cd0-250b-4023-af2c-5b95f8548849 on hv-cinder-85427 Aug 24 11:29:29.489946 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-28b56459-3944-464d-b67e-bc048b231449 req-367c7260-6961-4c2f-a59e-08c1a7e96803 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038218 Aug 24 11:29:29.490839 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 594/1220] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:30.808242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:30.809353 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:30.817681 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.818250 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.818758 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.819551 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.820198 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.820717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.872867 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-9f4dcfa0-dde9-48af-8516-83874c707244 req-5b10e513-2110-4f35-95be-8ba92ebea373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07833cd0-250b-4023-af2c-5b95f8548849", "tag": "52a096cf-f9f3-4765-98d7-99bc1da29b11"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:30.882505 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-9f4dcfa0-dde9-48af-8516-83874c707244 req-5b10e513-2110-4f35-95be-8ba92ebea373 service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.882969 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-9f4dcfa0-dde9-48af-8516-83874c707244 req-5b10e513-2110-4f35-95be-8ba92ebea373 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.883429 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-9f4dcfa0-dde9-48af-8516-83874c707244 req-5b10e513-2110-4f35-95be-8ba92ebea373 service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.894554 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-9f4dcfa0-dde9-48af-8516-83874c707244 req-5b10e513-2110-4f35-95be-8ba92ebea373 service nova] Creating event network-changed:52a096cf-f9f3-4765-98d7-99bc1da29b11 for instance 07833cd0-250b-4023-af2c-5b95f8548849 on hv-cinder-85427 Aug 24 11:29:30.899789 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-9f4dcfa0-dde9-48af-8516-83874c707244 req-5b10e513-2110-4f35-95be-8ba92ebea373 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094369 Aug 24 11:29:30.900391 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 595/1221] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:30.912861 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lazy-loading 'services' on Instance uuid 07833cd0-250b-4023-af2c-5b95f8548849 {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:29:31.005297 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-75a7cbbc-044b-40bd-bad5-f6c1d1eeb489 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "DELETE /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments/64f6f821-f4b9-469c-90dc-7188e54ceddb" status: 202 len: 0 microversion: 2.1 time: 0.201557 Aug 24 11:29:31.017298 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.019960 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.020214 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 627/1222] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:29:30 2022] DELETE /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments/64f6f821-f4b9-469c-90dc-7188e54ceddb => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:31.027911 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.028741 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.030212 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.031015 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.031834 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.032460 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.071987 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-2b9b5170-117c-4071-8863-5e400e2ef216 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060323 Aug 24 11:29:31.072709 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 596/1223] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:32.086377 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.088940 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.096544 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.097070 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.097509 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.098279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.098752 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.099242 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.128528 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-896c56af-cbb2-44a0-a49d-034682723829 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047349 Aug 24 11:29:32.129036 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 628/1224] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Aug 24 11:29:32 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:29:32.143281 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.143838 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.150451 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.150929 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.151381 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.152068 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.152512 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.152933 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.236922 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] HTTP exception thrown: Instance 07833cd0-250b-4023-af2c-5b95f8548849 is not attached to volume 64f6f821-f4b9-469c-90dc-7188e54ceddb Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Request method failure captured: Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: DELETE /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments/64f6f821-f4b9-469c-90dc-7188e54ceddb HTTP/1.1 Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgre-AOhz1WbC6jWKl-ym7-rf3bQ-KSF5CqmVtvDUmLK2hIycKtwhp7W3U_F8YAufOBCti7oYU2uZpTcA7AytmTIP6njCDLRJmUd0H6TAbs7aSa8OpRhLPAE6f02q9GftJU6ZjqDKMdmo33isGWGDjwK9LmvDRI035BHZPPsprLS4wE Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: a49cb5a236194efd92736ce55834d95a Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestMinimumBasicScenario-892047517 Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:29:32.239348 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a49cb5a236194efd92736ce55834d95a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a49cb5a236194efd92736ce55834d95a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a49cb5a236194efd92736ce55834d95a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a49cb5a236194efd92736ce55834d95a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestMinimumBasicScenario-892047517 Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: a49cb5a236194efd92736ce55834d95a Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-892047517 Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestMinimumBasicScenario-892047517-project Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 70ed3be3841a42fba100ab939d3d11e6 Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestMinimumBasicScenario-892047517-project Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:29:32.241238 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 07833cd0-250b-4023-af2c-5b95f8548849 is not attached to volume 64f6f821-f4b9-469c-90dc-7188e54ceddb Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'server_id': '07833cd0-250b-4023-af2c-5b95f8548849', 'id': '64f6f821-f4b9-469c-90dc-7188e54ceddb'} Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 64f6f821-f4b9-469c-90dc-7188e54ceddb. Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:29:32.242360 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07833cd0-250b-4023-af2c-5b95f8548849 is not attached to volume 64f6f821-f4b9-469c-90dc-7188e54ceddb Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07833cd0-250b-4023-af2c-5b95f8548849 is not attached to volume 64f6f821-f4b9-469c-90dc-7188e54ceddb Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:32.244136 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Returning 404 to user: Instance 07833cd0-250b-4023-af2c-5b95f8548849 is not attached to volume 64f6f821-f4b9-469c-90dc-7188e54ceddb {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:29:32.245407 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-f35d7e68-f8a9-4fed-867d-199688910a4b tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "DELETE /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments/64f6f821-f4b9-469c-90dc-7188e54ceddb" status: 404 len: 154 microversion: 2.1 time: 0.102398 Aug 24 11:29:32.245407 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 597/1225] 10.222.0.79 () {58 vars in 1416 bytes} [Wed Aug 24 11:29:32 2022] DELETE /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849/os-volume_attachments/64f6f821-f4b9-469c-90dc-7188e54ceddb => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:29:33.395586 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:33.396128 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.402918 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.403443 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.404123 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.404838 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.405279 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.405697 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.430343 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Going to try to terminate instance {{(pid=120789) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:29:33.518002 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-66b7b4d3-aa20-41d8-8fee-61c9b7f7faa5 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "DELETE /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 204 len: 0 microversion: 2.1 time: 0.126059 Aug 24 11:29:33.518483 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 629/1226] 10.222.0.79 () {58 vars in 1239 bytes} [Wed Aug 24 11:29:33 2022] DELETE /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:29:33.527085 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:33.527724 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.534195 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.534670 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.535149 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.535830 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.536270 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.536679 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.681961 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.policy [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120788) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:33.693649 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-88dccc7b-26e4-484c-bf21-a82fc0ae49f6 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1554 microversion: 2.1 time: 0.170216 Aug 24 11:29:33.694410 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 598/1227] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:33 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:34.720171 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:34.720754 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:34.728482 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.729018 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.729452 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.730213 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.730717 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.731215 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.873726 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.884224 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-cbc49d55-7fb4-48be-92a5-b5919ab68581 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1554 microversion: 2.1 time: 0.170101 Aug 24 11:29:34.884802 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 630/1228] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:34 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:35.801361 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [req-281491d1-2678-4a85-a427-6e751644df6b req-27fe3506-1d41-422e-93fb-c7392dfe4d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07833cd0-250b-4023-af2c-5b95f8548849", "name": "network-vif-deleted", "tag": "52a096cf-f9f3-4765-98d7-99bc1da29b11"}]} {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:35.812719 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-281491d1-2678-4a85-a427-6e751644df6b req-27fe3506-1d41-422e-93fb-c7392dfe4d9e service nova] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.813183 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-281491d1-2678-4a85-a427-6e751644df6b req-27fe3506-1d41-422e-93fb-c7392dfe4d9e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.813594 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [req-281491d1-2678-4a85-a427-6e751644df6b req-27fe3506-1d41-422e-93fb-c7392dfe4d9e service nova] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.825598 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.compute.server_external_events [req-281491d1-2678-4a85-a427-6e751644df6b req-27fe3506-1d41-422e-93fb-c7392dfe4d9e service nova] Creating event network-vif-deleted:52a096cf-f9f3-4765-98d7-99bc1da29b11 for instance 07833cd0-250b-4023-af2c-5b95f8548849 on hv-cinder-85427 Aug 24 11:29:35.831065 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [req-281491d1-2678-4a85-a427-6e751644df6b req-27fe3506-1d41-422e-93fb-c7392dfe4d9e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 Aug 24 11:29:35.831663 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 599/1229] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:35.909140 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:35.909768 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.compute.api [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120789) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.916271 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.916746 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.917168 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.918076 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.918519 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.919222 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.950764 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.951273 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.951707 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG oslo_concurrency.lockutils [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.952137 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.objects.instance [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lazy-loading 'fault' on Instance uuid 07833cd0-250b-4023-af2c-5b95f8548849 {{(pid=120789) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:29:35.993461 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.policy [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ed3be3841a42fba100ab939d3d11e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49cb5a236194efd92736ce55834d95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120789) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:36.001710 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-2758dda9-2b72-43ce-824a-e42b677b7b22 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 200 len: 1348 microversion: 2.1 time: 0.096385 Aug 24 11:29:36.002206 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 631/1230] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:35 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:37.028434 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '>' {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:37.029391 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.compute.api [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] [instance: 07833cd0-250b-4023-af2c-5b95f8548849] Fetching instance by UUID {{(pid=120788) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:37.036208 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.036682 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.037104 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.037783 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Acquiring lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.038233 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.038640 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG oslo_concurrency.lockutils [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Lock "f543127f-8947-4c5e-9781-e6e09b81ac8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.052459 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.wsgi [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] HTTP exception thrown: Instance 07833cd0-250b-4023-af2c-5b95f8548849 could not be found. Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Request method failure captured: Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: request: GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 HTTP/1.1 Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept: application/json Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Accept-Encoding: identity Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Connection: close Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Length: 0 Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Content-Type: application/json Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Host: 10.222.0.79 Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Openstack-System-Scope: None Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: User-Agent: python-urllib3/1.26.11 Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Auth-Token: gAAAAABjBgre-AOhz1WbC6jWKl-ym7-rf3bQ-KSF5CqmVtvDUmLK2hIycKtwhp7W3U_F8YAufOBCti7oYU2uZpTcA7AytmTIP6njCDLRJmUd0H6TAbs7aSa8OpRhLPAE6f02q9GftJU6ZjqDKMdmo33isGWGDjwK9LmvDRI035BHZPPsprLS4wE Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Id: None Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Domain-Name: None Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Identity-Status: Confirmed Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Is-Admin-Project: True Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Id: default Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Domain-Name: Default Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Id: a49cb5a236194efd92736ce55834d95a Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Project-Name: tempest-TestMinimumBasicScenario-892047517 Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Role: reader,member Aug 24 11:29:37.054174 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Roles: reader,member Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a49cb5a236194efd92736ce55834d95a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a49cb5a236194efd92736ce55834d95a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a49cb5a236194efd92736ce55834d95a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a49cb5a236194efd92736ce55834d95a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}] Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant: tempest-TestMinimumBasicScenario-892047517 Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Id: a49cb5a236194efd92736ce55834d95a Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-892047517 Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User: tempest-TestMinimumBasicScenario-892047517-project Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Id: default Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Domain-Name: Default Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Id: 70ed3be3841a42fba100ab939d3d11e6 Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: X-User-Name: tempest-TestMinimumBasicScenario-892047517-project Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: method: > Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: exception: Instance 07833cd0-250b-4023-af2c-5b95f8548849 could not be found. Aug 24 11:29:37.055915 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: action_args: {'id': '07833cd0-250b-4023-af2c-5b95f8548849'} Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: {{(pid=120788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07833cd0-250b-4023-af2c-5b95f8548849 could not be found. Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:29:37.056837 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07833cd0-250b-4023-af2c-5b95f8548849 could not be found. Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07833cd0-250b-4023-af2c-5b95f8548849 could not be found. Aug 24 11:29:37.058302 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: ERROR nova.api.openstack.wsgi Aug 24 11:29:37.059664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: DEBUG nova.api.openstack.wsgi [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Returning 404 to user: Instance 07833cd0-250b-4023-af2c-5b95f8548849 could not be found. {{(pid=120788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:29:37.059664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO nova.api.openstack.requestlog [None req-86297c13-03b4-4bd4-8095-09309d656ed2 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849" status: 404 len: 111 microversion: 2.1 time: 0.034923 Aug 24 11:29:37.059664 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: [pid: 120788|app: 0|req: 600/1231] 10.222.0.79 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:37 2022] GET /compute/v2.1/servers/07833cd0-250b-4023-af2c-5b95f8548849 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:29:37.064696 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: DEBUG nova.api.openstack.wsgi [None req-db56e1ef-88af-4b96-9fca-c2260ad87c00 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] Calling method '.version_select at 0x7f82b6b75310>' {{(pid=120789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:37.090217 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO nova.api.openstack.requestlog [None req-db56e1ef-88af-4b96-9fca-c2260ad87c00 tempest-TestMinimumBasicScenario-892047517 tempest-TestMinimumBasicScenario-892047517-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1795060525" status: 202 len: 0 microversion: 2.1 time: 0.029372 Aug 24 11:29:37.090781 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: [pid: 120789|app: 0|req: 632/1232] 10.222.0.79 () {58 vars in 1272 bytes} [Wed Aug 24 11:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1795060525 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:52.890938 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:31:52.892002 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:31:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:31:53.933882 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:31:53.934878 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:31:56.800641 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:31:56.801582 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Wed Aug 24 11:31:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:32:08.701142 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:32:08.701733 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:32:12.995646 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:32:12.996555 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Wed Aug 24 11:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:35:04.462406 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:35:04.463166 dv-cinder-854272-2-iscsi devstack@n-api.service[120789]: Wed Aug 24 11:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:35:12.904001 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:35:12.904601 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:35:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:35:13.946760 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:35:13.947470 dv-cinder-854272-2-iscsi devstack@n-api.service[120788]: Wed Aug 24 11:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!